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The  feasibility  of  identifying  mid-water  nekton  at  100  meters  in 
clear  ocean  water  using  a fan  shaped  laser  beam  in  conjunction 
with  a photodiode  array  detector  in  a towed  system  is  examined. 

It  has  been  found  that  for  myctophids  and  euphasiids,  identifica- 
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and  light  source  limited.  Calculations  are  presented  that  show 
the  need  for  either  computer  or  optical  pattern  recognition  for 
the  rapid  identification  and  counting  of  these  nekton.  Both  geo-  - 
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-^metric  and  bioluminescent  characteristics  are  examined  as 
possible  candidates  for  recognition  parameters.  At  high 
tow  rates ( about  10  knots),  the  need  for  optical  pattern 
recognition  has  been  found  to  be  necessary.  Methods  are 
suggested  for  both  optical  pattern  recognition  and  sea  water 
optical  characteristic  simulation  to  evaluate  developed 
optical  recognition  systems  for  myctophids. 

An  appendix  presents  general  characteristics  of  mid-water 
nekton  with  an  analysis  of  the  electronic  transmission  re- 
quirements and  limitations  at  mid-water  depths.  A selected 
bibliography  is  also  presented  on  mid-water  nekton. 
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STUDY  OF  THE  FEASIBILITY  OF  USING  AN  ADVANCED  OPTO-ELECTRONIC 
IMAGING  TECHNIQUE  FOR  SAMPLING  MID-WATER  NEKTON 

The  motivation  and  need  for  developing  a system  for  recognizing 
and  counting  mid-water  nekton  using  pattern  recognition  stems  from 
need  of  developing  new  sampling  techniques  as  a result  of  the, 
"Workshop  On  Problems  Of  Assessing  Population  Of  Nekton",  held  in 
Santa  Barbara,  Calif,  in  1975  sponsered  by  ONR  and  the  National 
Science  Foundation. 

The  initial  phase  of  this  work  (approximately  4 months)  conducted 
under  Contract  No.  N00014-77-C-0344 , was  concerned  with  the  study 
of  the  image  requirements  for  developing  "intelligence"  for  identi- 
fying small  mid-water  nekton  in  a towed  system  currently  being  de- 
veloped by  the  Navy.  This  phase  addressed  the  problem  of  resultant 
image  quality  and  requirements  for  identification.  This  preliminary 
study  has  indicated  that  a towed  system  must  operate  within  10  to 
20  meters  of  the  nekton  with  the  myctophids  and  the  euphasiids  re- 
presenting the  lower  limit  of  nekton  recognition.  For  rapid  identifi- 
cation, a pattern  recognition  hierarchy  is  found  to  be  necessary.  Both 
geometric  and  bioluminecent  characteristics  of  the  myctophids  were 
examined  as  possible  candidate  recognition  parameters. 

The  second  phase  of  this  work  (approximately  3 months)  conducted  under 
Co  _ract  No.  N00014-78-C-0253  addressed  the  problem  of  high  tow  rates. 
It  has  been  found  that  at  tow  rates  of  up  to  10  knots  that  optical 
pattern  recognition  is  necessary  as  computer  pattern  recognition  can- 
not meet  the  high  data  transfer  rate  requirements.  Suggestions  are 
made  on  the  technique  to  be  used  for  accomplishing  optical  pattern 
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recognition  of  myctophids.  In  addition,  it  is  shown  how  the  sea  water 
optical  characteristics  can  be  simulated  optically  to  assess  the 
ability  of  optical  pattern  recognition  techniques  to  identify  myc- 
tophids  or  other  small  nekton. 

An  appendix  presents  general  nekton  characteristics  with  an  analysis 
of  the  electronic  requirements  for  data  transmission  through  a cable 
at  mid-water  depths.  A selected  bibliography  on  mid-water  nekton  is 
also  presented. 
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I INTRODUCTION 

The  study  of  the  marine  ecology  requires  quantitative  esti- 
mates on  the  standing  stocks  of  nekton  to  assist  in  evaluating 
the  structure  and  dynamics  of  marine  ecosystems.  Nekton  pop- 
ulations comprise  a large  portion  of  the  living  biomass  and  may 
have  a major  role  in  recycling  of  elements  and  regulating  the 
structure  of  population  at  lower  trophic  levels. 

As  no  one  method  of  sampling  is  adequate  for  an  understanding 
of  the  nekton  role  in  the  marine  ecosystem,  a judicious  mix  of 
techniques  and  technologies  that  complement  each  other  could  in- 
crease the  ability  to  assess  nekton  populations. 

For  the  basis  of  the  ensuing  discussion ,meso-pelagic (mid-water ) 
nekton  includes  animals  capable  of  moving  from  place  to  place  be- 
tween 200  to  2000  meters.  By  definition,  this  consists  primarily 
of  vertebrates ( fish) , squid (Cephalopods)  and  some  forms  of  higher 
crustaceans (Decapods) . The  great  mass  of  invertebrates  is  exclud- 
ed due  to  the  lack  of  directed  and  sustained  locomotion. 

Quantitative  analysis  of  nekton  populations  can  provide  val- 
uable data  pertinent  to  food  web  composition,  estimation  of  com- 
mercial and  sports  fisheries  harvest  and  investigation  of  bio- 
acoustics phenomena. 

Sampling  per  se  in  meso-pelagic  waters  is  compounded  by  the 
lack  of  a single  technique  capable  of  providing  reliable  ident- 
ification and  enumeration  of  all  species  within  a search  area. 

Basically,  the  problem  can  be  defined  in  terms  of  biological 

and  non-biological  factors  limiting  the  suitability  of  equipment 

(1) 

currently  being  used  for  this  purpose: 
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TRAWLS 


Mid-water  trawls  of  the  U.S.  fleet  are  limited  to  small  pel- 

2 

agio  animals  due  to  inadequate  nets  (^200  meters  mouth 
opening)  and  the  inability  to  sample  at  discrete  depths.  Net 
avoidance  is  observed  among  strong  swimmers  and  can  only  be  over- 
come in  part  by  using  1600  mesh  nets  with  mouth  openings  of 
2 

1000  meters  or  larger.  Operation  of  such  nets  is  very  expensive 
as  well  as  requiring  specially  equipped  vessels  for  their  de- 
ployment. 

EGG  AND  LARVAL  STUDIES 

Low  cost  ichthyoplankton  surveys  have  been  popularized  for 
investigating  population  dynamics  of  fishes,  detection  and 
appraisal  of  fishery  resources  and  studies  in  biology  and 
systematics.  Abundance  and  distribution  of  adults  can  only 
be  monitored  by  this  method  in  the  spawning  area  during  the 
spawning  season.  Sampling  is  generally  considered  to  be  very 
poor  in  surveys  of  this  type  compared  to  that  obtained  by 
acoustic  eggs  or  larvae,  or  being  demersal  in  nature,  would 
not  be  detected  by  this  method.  Thus,  the  value  of  mid-water 
ichthyoplankton  surveys  in  estimating  adult  biomass  is  se- 
riously limited. 

ACOUSTICAL  TECHNIQUES 

Low  frequency  (broadband  systems)  studies  of  mesopelagic 
nekton  provide  excellent  information  on  the  presence  or 
absence  of  fish  with  swim  bladders.  In  particular  this  has 
provided  detailed  insight  into  the  vertical  migration (diurnal) 
of  Mycophidae  and  siphonophores  of  the  suborder  Physonectae . 
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The  former,  characterized  by  lantern  fish,  have  a gas-filled 
swim  bladder  resonant  for  sound  pulses  from  1?  to  24  kHz. 

Physonectae , polymorphic  coelenterates  containing  bubbles  of 
carbon  monoxide, similarly  respond  to  echo  sounder  frequencies. 

Although  acoustical  techniques  for  assessment  of  nektonic 
populations  provide  acceptable  levels  and  continuity  of 
sampling,  the  method  had  has  several  short  comings:  Fish  with- 
out swim  bladders  can  not  be  detected  and  species  identification 
and  packing  densities  requires  anciliary  data  as  trawls  for 
verification. 

REMOTE  SENSING 

Direct  aerial  observations  and  photography,  including  multi- 
spectral  imaging,  are  limited  to  nekton  in  epipelagic  waters 
under  the  best  of  environmental  conditions . Some  fish  are  known 
to  have  unique  spectral  signatures  and  can  be  identified  from 
the  air.  Tuna  schools  are  routinely  tracked  at  night  and 
biomass  estimates  made  by  virtue  of  the  intensity  of  the  bio- 
luminescent  signal  from  disturbed  waters.  This  would  not  be 
seen  under  conditions  of  ambient  lighting  or  adverse  weather 
conditions.  Again,  anciliary  information  is  required  to  confirm 
the  accuracy  of  the  airborne  data. 

DIRECT  OBSERVATION  BY  SUBMERSIBLES , TELEVISION  AND  PHOTOGRAPHIC 
METHODS 

Valuable  data  has  been  obtained  from  submersibles  in  the  meso- 
pelagic  zone  and  has  provided  basic  information  on  the  vertical 
(diurnal)  migration  of  sound  scattering  layers.  Unfortunately 
use  of  such  craft  is  not  practical  for  large  area  surveys  due 
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to  the  limited  "window"  (sampling  area)  for  TV, cameras  and 
observers.  The  latter  may  not  be  able  to  identify  all  nekton 
observed  and  sample  collection  capability  is  usually  quite 
limited.  It  also  appears  that  some  nekton  may  avoid  submer- 
sibles , possibly  due  to  lights, motor  sounds  etc.  and  only  be 
seen  as  a matter  of  chance.  Based  on  comparison  of  operation- 
al costs  and  the  amount  of  data  retrieval,  submersibles  are 
highly  impractical  for  meso-pelagic  surveys.  Populations 
have  been  surveyed  by  operation  of  conventional  remote  sur- 
veillance systems;  however,  concern  exists  that  studies  of 
motile  animals  may  similarly  be  influenced  by  sounds , lights 
and  mechanical  disturbances. 

FOOD  HABITS 

Examination  of  the  stomach  of  carnivores,  e.  g.,  seals,  sperm 
whales,  dolphins  and  porpoises,  salmon  etc.,  can  provide 
valuable  information  regarding  nektonic  composition  through- 
out the  water  column.  In  many  instances  large  and  small  nekton 
infrequently  caught  in  nets  are  extensively  seen  in  the 
stomachs  of  sperm  whales  and  Alepisaurus  sp. , respectively. 

Based  on  the  aforegoing  it  can  be  readily  seen  that  non  of  the 
techniques  currently  in  use  can  satisfactorily  provide  unbiased 
and  statistically  valid  profiles  of  meso-pelagic  nekton. 

Common  problems  shared  in  most  cases  include; 

1.  Inadequacy  of  sample. 

2.  Aversion  phenomena  associated  with  environmental 
disturbances  (light,  sound  and  /or  mechanical) . 

3.  Difficulty  of  correlating  survey  methods  with 
species  identity  and  density  of  biomass. 
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4.  Lack  of  real-time  capability  for  vertical  and 
horizontal  profiling. 

5.  Requirement  for  manual  sorting  of  trawls  and 
species  identification  by  taxonomista. 

6.  High  cost  in  relationship  to  the  quality  and 
quantity  of  data. 

It  is  not  expected  that  a new  system  can  circumvent  all  of  the 

problems,  but  suggest  that  the  "window"  of  an  advance  nekton 

o 

optical  monitoring  system  would  be  comparable  to  an  1000  m 
opening  of  nets  currently  in  use  on  West  German,  Polish  and 
Soviet  research  vessels. 

Although  net  sampling  is  the  most  direct  sampling  technique, 
it  appears  that  the  avoidance  of  motile  animals  and  bias  produced 
by  the  net  size  is  a serious  problem.  In  order  to  augment  the  net 
sampling  technique  and  to  obvia  e the  disadvantages  of  the  systems 
indicated  above,  the  development  of  an  opto-electronic  imaging 
system  using  an  optical  pattern  recognition  scheme  to  be  used  in 
conjunction  with  an  existing  towed  fish  is  desirable  that: 

a.  produces  a mouth  opening  equivalent  to  that  encompassed 
by  large  nets 

b.  uses  monochromatic  light  which  minimizes  the  effect  of 
lights  on  motile  animals  characteristic  of  white  light 
sources 

c.  provides  the  requisite  recognition  parameties  to  identify 
and  count  nekton  density 

d.  minimizes  backscattering  which  limits  contrast  in  con- 
ventional TV  systems 


e.  transmits  only  useful  information  therby  reducing 
information  storage  capacity 

A possible  scenario  is  depicted  in  Figure  1.  Here  a research 
vessel  (mother  ship)  suitably  modified  to  provide  a platform  to 
station  the  controls  for  a towed  fish  (sensor)  is  indicated.  The 
controls  may  consist  of  a suitable  display,  microcomputer,  receiver 
and  transmitter.  The  cable  is  used  to  deploy  the  towed  fish  and  to 
transmit  power  and  receive  data  from  the  fish.  The  towed  fish  may 
also  consist  of  a laser  source  (operated  in  pulsed  or  CW  mode) , a 
viewing  system,  an  electronic  film  plane  (e.g.  photodiode  array) 
and  an  electronic  processing  unit. 

The  laser  source  (e.g.  argon,  He/Cd  or  doubled  YAG)  is  chosen 
for  its  ability  to  be  pulsed  or  run  continuously.  The  laser  light 
emanates  from  one  end  of  the  towed  fish  and  the  viewing  system  is 
located  at  the  other  end  providing  a seperation  of  source  and  viewing 
system  of  about  10  meters.  The  laser  beam  is  shaped  into  a fan  of 
light  by  suitable  optics  (i.e.  sheet  of  light)  which  diverges  in  one 
direction  and  is  essentially  collimated  in  the  other  direction.  In 
addition,  it  is  moved  mechanically  (e.g.  rotating  mirror)  to  pro- 
vide a scan  angle  for  the  fan  beam  sweeping  out  an  unsymmetrical  wedge 
shaped  volume.  The  viewing  system  is  also  scanned  mechanically  in 
synchronism  with  the  scanning  light  source. 

The  scanning  light  source  and  viewing  system  share  a common  vol- 
ume. This  methode  of  operation  reduces  back  scattering  to  such  an 
extent  that  the  viewing  range  is  about  6 attenuation  lergths.  For 
clear  ocean  water  ( attenuation  coefficient  alpha  about  .05  meter  *) , 
this  corresponds  to  a range  of  about  120  meters.  If  a pencil  of  light 
is  used,  the  range  can  be  extended  to  about  7 attenuation  lengths; 
however,  the  increased  complexity  of  the  resulting  system  does  not 


warrant  it.  For  simple  TV  type  flood  light  illumination,  depending 
on  the  water  turbidity,  it  is  about  4.5  attenuation  lengths.  It  is 
believed  that  a dual  synchronism  scan  system  for  imaging  represents 
the  best  compromise  between  sensor  complexity  and  range. 

Although  there  are  many  variables  that  will  affect  the  performance 
of  the  viewing  system  described  above  (e.g.  water  turbidity,  contrast 
of  the  fish,  efficiency  of  the  overall  viewing  system  and  resolution 
and  range  requirements) , it  is  believed  that  such  a system  augmented 
by  a suitable  pattern  recognition  system  would  represent  a quantum 
jump  in  the  way  sampling  is  conducted  for  mid-water  nekton. 

In  the  following  section,  we  analyze  the  ability  of  a fan  beam 
and  a dual  synchronous  system  to  image  in  clear  ocean  water  small 
mid-water  nekton  and  to  determine  the  limitations  of  such  a system. 


II  ANALYSIS  OF  FAN  BEAM  IMAGING  IN  SEA  WATER 


A.  Introduction 

The  problem  we  are  addressing  is  to  determine  the  requisite 
spatial  resolution  as  a function  of  contrast  of  the  object  and  the 
detector  signal-to-noise  ratio  of  a viewing  system  whose  sensor  is 
a self-scanned  imaging  array  of  detectors  and  whose  illuminating  source 
is  a scanning  fan  beam.  In  this  analysis,  it  is  assumed  that  the  field- 
of-view  (FOV)  is  fixed.  The  use  of  a fixed  FOV  is  not  a necessary  re- 
striction; however,  if  the  results  indicate  that  it  is  responsive  to 
the  requisite  requirements  for  nekton  viewing,  it  would  simplify  the 
fabrication  of  such  a system. 

The  system  geometry  is  indicated  in  Figure  2.  Here,  a fan  beam  of 
light  (i.e.  laser  or  non-laser)  of  fan  angle  is  directed  such 

that  the  fan  angle  covers  the  vertical  FOV  of  the  detector  system  at 
a given  time.  As  the  fan  beam  scans  in  the  horizontal  direction,  it 
covers  the  fixed  FOV  of  the  detector  system. 

At  any  given  instant,  the  fan  beam  at  the  range  R will  be  dis- 
persed due  to  particulate  scattering  and  attenuated  due  to  particles 
and  dissolved  materials  in  the  water.  As  a result,  the  resultant 
angular  intensity  of  the  beam  at  a given  range  depends  on  the  water 
scattering  and  attenuation  properties  in  addition  to  the  range. 

For  a viewing  system  that  is  to  perform  beyond  an  attenuation 
length,  it  is  necessary  to  take  into  account  multiple  scattering. 

Due  to  the  fact  that  there  is  no  satisfactory  expression  in  closed 
form  that  describes  this  process,  we  utilize  the  theory  of  MTF  for 
analyzing  the  foward  scattering  process.  As  our  ultimate  goal  is 
angular  resolution,  MTF  theory  (modulation  transfer  function)  pro- 
vides a means  for  determining  this  process  in  closed  form,  knowing 
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the  volume  scattering  function,  C3"(  0 ) , valid  for  single  scattering 
only  and  the  attentuation  coefficient  of  the  sea  water. 

B.  Derivation  of  the  Transfer  Equations 


In  order  to  use  MTF  theory,  it  is  necessary  to  know  the  response 


of  the  system  to  a point  source  (impluse  response  in  electronics  or 


Green's  function  in  mathematics).  The  point  source  will  produce,  after 


passing  through  the  system,  a point  spread  function, S ( 0 ) , which 


characterizes  how  a point  source  of  light  is  dispersed  spatially  on 


the  observation  plane.  As  the  fan  beam  can  be  considered  to  made  up 


of  many  point  sources,  the  resultant  distribution  becomes  a summation 


process . 


The  situation  is  depicted  in  figure  3.  We  use  angular  coordinates 


rather  than  spatial  coordinates  due  to  the  dependence  of  the  results 

on  range.  The  0 and  0 axis  represent  the  coordinate  axis  of  the 
x y 

target  plane.  It  is  found  that  referring  all  results  to  the  target 


plane  simplifies  the  analysis.  The  coordinates  indicated  in  paren- 


thesis are  dummy  variables  used  for  the  integration. 


Consider  the  fan  beam  in  an  ideal  medium  at  the  range  R.  At  the 


target  plane,  the  fan  beam  can  be  represented  mathematically  as  a 
rectangle  function  (Rect)  in  the  £.  direction  and  a delta  (&)  in  the 
direction.  In  the  Yj  direction  we  assume  that  diffraction  effects 
are  negligible  and  that  the  spatial  dispersion  is  caused  only  by  the 


sea  water  scattering.  In  addition,  we  assume  that  the  point  spread 


function  is  known,  ( e„.ey  ) , as  we  describe  later  how  this  func- 


tion is  derived  from  the  scattering,  and  attentuation  coefficients. 


If  at  a given  time,  the  fan  beam  is  located  at  say  YJ  , then  the 
fan  beam  can  be  written  as  Rect(  £,  ) £>  ( ) where  |£|^^  . A point 


in  the  fan  beam  is  dispersed  bt  S (0,0)  and  hence  is  written 

P x y 


m 


i 
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as  S (0  - 0 , 0 - E.  ),  (i.e.  the  S is  displaced  to  19  , £,  ). 

p x 1 y p 

Consequently,  the  resultant  angular  dispersion  of  the  fan  beam  is  the 
summation  of  the  displaced  spread  function  over  the  length  of  the 

fan  beam.  This  can  be  written  as, 

co 

sL(e*,ey,-R)=  /'sP(6,-t?)9y-e.-R)^T(e)S6i^£  (1) 


— oo 


where , S now  represents  the  line  spread  function  of  the  fan  beam 

X* 

located  at  0 . Integrating  out  the  19  , we  have  that, 

A 


su(^r«?.A.10  = J SpC^-r^ey-e/R)  i?«ct  co 

-A 

As  equation  (2)  is  a one  demensional  convolution,  we  have  from 
Fourier  Transform  theory  that. 


(2) 


^ = S sin  oJfly 


^y/p/2 


(3) 


where,  CJ^yis  the  conjugate  angular  variable  to  0y  (i.e.  radians  of 

spatial  frequency/  radians  of  angle)  and  the  symbol  means  the 

transform  of.  This  expression  will  be  utilized  later  in  the  derivation. 

As  can  be  seen  that  if  the  S is  known  in  closed  form,  the  resultant 

P 

resolution  due  to  the  fan  beam  can  be  determined  in  frequency  space. 

Expression  (2)  represents  an  irradiance  function.  It  is  now 

necessary  to  consider  how  this  irradiance  reflecting  off  of  a target 

is  viewed  by  the  imaging  system.  A lens  looking  at  a point  on  this 

distribution  sees  a blur  given  again  by  S . In  this  derivation,  it 

p 

is  assumed  that  the  difference  in  the  range  R from  the  illuninator 
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to  the  target  and  from  the  viewing  system  to  the  target  is  negligible. 
As  before,  each  point  on  the  target  plane  is  viewed  as  a blur  and 
the  resulting  intensity  distribution  is  a summation  of  this  blur  over 
the  irradiance  of  the  object.  Consequently, 

1(0X)©>)  ^ jj (4) 

— OO 

wherey£(  tj),  £ ) represents  the  target  reflectivity  and  1(0,0) 
represents  the  apparent  intensity  as  viewed  by  the  detector  system 
at  the  angular  coordinates  ( 0 0..  ) . As  before,  equation  (4)  rep- 


resents a convolution  of  S with  S,  O . 

P Ly 

domain,  equation  (4)  can  be  written  as. 


Consequently,  in  the  frequency 


I = SP  • Suy9 


However  sLy^  = Sjj2Dpwhere  © stands  for  convolution.  Substituting  from 
equation  (3)  we  have  that, 

— * ^ ^ SmtOou  A/?, 

T - ‘ D = SD  • On /> 


I - Sp  ‘ = Sp  • Op 


It  is  interesting  to  note  that  if  the  of  SL  were  also  a variable 

(i.e.  broader  beam  illumination),  equation  (6)  would  read. 


1*  - Sp  ® SL.y>  - Sp®  Sp 


s i r\ 

yBf/z 


Comparing  (6)  with  (7)  we  see  that  in  a broader  beam  illumination, 

resolution  can  be  derived  from  the  illuminator  and  detector  as  a 

convolution  in  frequency  space  means  a greater  resolution.  In  the 

case  of  the  fan  beam,  the  product  represents  less  resolution 

P L 
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while  convolution  with^?  represents  greater  or  less  resolution 
depending  on  the  frequency  content  oi  yO  . 

In  any  event,  equation  (6)  is  the  basic  equation  that  will  be  used 
for  subsequent  calculations  and  represents  the  imaging  ability  of  the 
entire  system  at  a given  position  of  the  fan  beam. 

C.  The  Point  Spread  Function 

In  order  to  utilize  equation  (6),  we  require  an  expression  for  S 

P 

or  more  explicitly,  S . It  has  been  shown  by  Wells'  ' that  the  trans- 

P 

form  of  the  point  spread  function  can  be  written  as. 


Sp  =i  e 


- D(v)  R 


where. 


V = spatial  frequency  (cycles/radian) 


D(l/)  = 


with. 


- -fk 


<s*i  9t  ) dt  (frequency  decay  function) 


O'  ( 0)  = volume  scattering  function 
= attentuation  coefficient 

Here,  OT  ( 0 ) is  expressed  as  the  Fourier-Bessel  transform  of  <3* 
( 0 ) and  is  written  as. 


cyCo)  ^ 2ir  / T0(uj©)c5 '(0)6d0  (9) 

where,  J ( co©  ) is  the  zero  order  Bessel  function  and  € represents 
o 

the  dividing  angle  between  small  and  large  angle  scattering.  The 
calculation  of  D(  ) requires  an  analytical  expression  for  G-  ( G ). 


Wells  has  proposed  the  following  as  an  adequate  expression  for  the 
foward  scattering. 


a-xe)  ~ 


(10) 


s 9o 

where,  s and  0 are  adjustable  parameters  and  s is  given  by. 


S - O'-'T  -2TT  tt(Q')  0 dQ 


with  r = broad  beam  attentuation  coefficient  (i.e.  "Y"  represents 

the  fraction  of  light  scattered  out  of  a cone  of  light,  taken  usually 

as  10°)  while  s represents  the  fraction  of  light  within  the  cone. 

Consequently,  a given  0 and  & defines  D(  V ) which  in  turn 

o 

defines  S . 

P 

D.  Normalization 

In  above  derivations,  no  attempt  was  made  to  normalize  the  re- 
sulting equations.  This  can  be  done  by  noting  that  the  S(  G , R) 
is  defined  as  the  fraction  of  power  at  the  range  R per  unit  solid 
angle  ( -O-  ) . If  we  assume  that  most  of  the  scattering  is  contained 
in  the  forward  direction  (i.e.  large  particles  of  radius  ± u ), 


then, 


with  P the  total  power  in  the  beam.  Consequently,  P S ( © , R) 

O O L 

represents  the  fraction  of  power  falling  on  the  target  at  R per  unit 
solid  angle.  If  we  assume  unit  reflectivity  of  a Lambertian  target, 
then  the  reflected  radiation  from  the  target  is  PQS L / TT  • A de- 
tector system  viewing  this  target  has  an  angular  area  of  its  res- 


olution element  of  T T where  £ t represents  the  angular  radius. 


The  collector  lens  views  each  radiating  point  with  a solid  angle 
2 

of  Ad/R  where  A^  is  the  collection  area.  As  viewed  by  the  detector, 
the  normalized  return  is  just  PG  ^t^D/R2  . This  represents  the 
fraction  of  power  received  by  a given  resolution  element  in  the  de- 
tector system.  Utilizing  short  hand  notation,  equation  (4)  can  be 
written  as, 

1 1 U3) 

In  terms  of  received  photons  necessary  for  the  noise  calculations 
below,  we  have  that, 

4>s  ( 0/,  e>)  = o| 


where,,  N ^ = number  of  photons  /joule  and  t = integration  time. 
Equation  (14)  transformed  reads. 


^ €-t  Aat  ( 

**  t 


(15) 


Equation  (15)  represents  the  signal  per  unit  frequency  interval 
received  by  the  detector  having  a resolution  of  £ looking  at  the 
coordinates  9 x'  ^ y at  the  range  R with  the  fan  located  at  ^ 0- 
E.  Background,  Signal-To-Noise  Ratio  and  Contrast 

As  equation  (15)  represents  the  signal,  it  is  necessary  to  ca- 
lculate the  expected  background  due  to  backscattering  from  the  beam 
into  the  FOV  of  the  detector.  We  will  assume  that  the  projected  fan 
beam  dispersed  by  the  sea  water  will  look  like  an  elliptical  cylinder 
(figure  4) . The  viewing  system  looking  at  an  resolution  element  in 
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the  middle  of  the  cyclinder  "sees”  a column  of  scattered  light  de- 
# 

termined  by  the  angle  between  the  beam  and  detector  axis.  The  maximum 
scattering  occurs  at  the  center  of  the  cylinder  as  this  point  has  the 
widest  angular  spread.  The  relationship  between  the  angle  of  viewing 
and  the  radial  spread  ( Q (containing  most  of  the  energy)  can 


be  written  as. 


max 


r 


2-  0 MAX  ^ 
+ an 


(16) 


where,  r is  the  distance  through  which  a resolution  element  is  viewed 

and  r is  the  viewing  angle  with  0 about  10°.  The  backscatter- 

max 

ing  can  be  characterized  by  the  backscattering  coefficient  O'- (180°) 

D 

which  has  units  of  fraction  scattered  per  unit  length  per  unit  solid 

angle.  Hence,  O r is  the  diffuse  reflectivity  in  the  backward  di- 

B 

rection  ( toward  the  viewing  system) . This  derivation  assumes  that 

the  O'  does  not  vary  much  over  a wide  arc  at  180°.  As  the  angular 
B 

spread  is  determined  by  the  S and  it  is  viewed  as  a blur  determined 

L 

by  S , the  resultant  background,  analogous  to  equation  (15),  is, 

P 


P0  AD*b  ir  cfe  r 

-R* 


(17) 


In  order  to  relate  the  signal-to-noise  ratio  (SNR)  of  the  detector 
with  the  medium  and  target  transform,  we  proceed  as  follows: 

The  receiver  contrast  in  terms  of  SNR  can  be  written  as, 


SNR 

R -/sTb 


(18) 


With  the  SNR  fixed,  the  receiver  contrast  can  be  computed  from 
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B 


I 


1 i 

I ll 
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equations  (15)  and  (17).  Comparing  (15)  and  (17)  we  note  that  the 
signal  S can  be  written  as  S = ^ ^ 2 and  the  background  B = 

4V  e 2 


s t 

Substituting  in  (18)  we  have  that. 


Cp  = 


SNR 


(19) 


Equation  (19)  indicates  that  the  smaller  the  resolution  required, 
the  higher  the  contrast  must  be  to  meet  the  SNR  requirement.  Using 
the  Rayleigh  criterion  for  resolution,  we  have  that. 


2.TT  V = I-  22.  TT 


(20) 


and  hence  1/ 


1.6.  As  a result  we  have  that. 


1/. 


(21) 


B 


Equation  (21)  relates  the  spatial  frequency  to  the  detector  contrast 
and  the  SNR.  Note  that  the  CR  is  directly  proportional  to  U con- 
trary to  the  MTF  of  the  medium- target  system.  The  MTF  of  the  com- 
bined system  was  derived  above  as. 


CMT(bO  = SP  * 


(22) 


normalized  to  V =0. 

Finally,  we  equate  (21)  to  (22)  to  satisfy  both  detector  and  sys- 
tem requirements  as. 
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Sp’  SL®yO  — (23) 

V <&  + 4>b 

A seperate  plot  of  each  side  of  the  equation  will  produce  a crossing 

point  at  some  2^  which  is  the  maximum  resolution  of  the  entire  sys- 

o 


F.  Evaluation  of  the  Contrast  Functions 

As  a starting  point  we  have  chosen  those  parameters  that  are 

characteristic  of  clear  ocean  water  starting  at  about  500  meters  in 

depth.  The  parameters  that  chracterize  the  water  are  0(  , the  at- 

tentuation  coefficient;  st  , the  total  scattering  coefficient;  s , 

the  scattering  coefficient  for  a broad  beam  and  0O , a parameter  that 

characterizes  the  volume  scattering  function  along  with  a (see 

equation  (10).  The  parameters  we  have  chosen  were  taken  from  the 

(3) 

work  of  D.  Matlack  in  which  the  attenuation  coefficient  measure- 
ments and  scattering  at  15°  and  33°  were  made  down  to  about  5000 
meters  for  several  ocean  areas.  From  a typical  deep  ocean  enviroment 
we  chose  the  following  parameters: 

& = .05  meter  ^ 

sT  = .005  meter-1 (based  on  15°  and  33°  scattering  data) 
s = .0025  meter-1  steradian  1 (estimated) 

0o=  .15  radians  (based  on  fitting 

These  parameters  represent  the  scattering  and  attentuation  properties 
at  about  432  nm. 

Before  proceeding,  it  is  necessary  to  evaluate  ^spx 's^.  This  factor 
appears  in  all  of  the  relevant  transmission  equations  derived.  We 
call  this  factor  , which  represents  the  imaging  characteristics. 
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...... w.gp. 
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V I 


t 


of  the  ocean/fan  beam  combination.  Hence  we  write. 


gr.s -=tc<*>,<W=e  -e 


.t,WR  -DWR6ln(w>sin4yjfA) 


OJ  Sin  (pySp/z.  (24) 


or. 


s^-  sL  - TXco;  <p)  - e 


-2t>Cu/)R  sm  C60  S»n4>  A=^) 


6u  S/n^ySF/2. 


(25) 


(2) 


It  has  been  shown  by  Wells  , that  D( CD  ) can  be  written  as, 


D C to)  - 0^ 


r — CO 

su-e  J 


co  Oc 


(26) 


Substituting  we  have  that. 


-2.o/"R  ^srL'  ■ 5in[hJ  snor^F^-l 

TrCoo,  $)  - e -e 


COSIM  ctjyfip/2. 


(27) 


In  order  to  compute  the  expected  resolution  for  the  sea/light  source 
system  as  expressed  in  equation  (22),  we  now  evaluate,  for  a range 
of  100  meters. 


^ ®yO(ui) 


(28) 


It  is  to  be  noted  that  the  convolution  expressed  by  (28)  is  only  in 
the  COy  direction.  As  a result,  we  have, 

, ^ .s’  Cl-  G.~  ',St°y)  sin  , 1 7coy  \ 

e • e— 

(29) 


CMT(co) 


,|7cuy 


. 


U 
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The  factor  sine  .17  coy/  .17  coy  has  its  first  zero  at  . 17  <Oy  =*TT 
or  2 TT  (.17)  Vy  = M . Hence  = 1/.34  *=  3 cycles/radian.  As  the 
secondary  zeros  of  the  sine  function  are  much  lower  in  magnitude, 
we  can  approximate  the  sine  function  by  an  one  demensional  delta 
function  (i.e.  it  has  the  effect  of  reproducing  the (^y)  with- 
out  modification) . In  addition,  the  /)  ( C Ox)  represents  the  sampling 
of  the yO  ( ) at  some  frequency  component.  With  these  modifica- 

tions we  can  write  that, 

.sO-e'Sw> 


c„T(w)  = e''0  • <?' 


• l S'  co 


•y°s^)yO  Cujy) 


(30) 


where ( cOx ) means  the  sampled  value  of  the  X component  ofyO 
(co).  It  is  also  noted  that  the  expression  1 - e~  ’ • lrJCO  go< 
to  1 as cO  goes  to  zero.  Hence  at  tcJy  = 0,  we  have  that. 


cMT(°)  = e*9y3 (°) 


(31) 


3' 


As  CO  goes  to  oo  , c becomes , 

CMT  ( <=^)  = e" ' °J5~s  ^ (32) 

-9  -10 

This  indicates  that  the  contrast  goes  from  a peak  of  e to  e 
Before  proceeding,  it  is  now  necessary  to  consider  the  ramifications 
of  sampling  in  the  direction. 

G.  Sampling  Theory 

The  fan  beam  at  each  position  in  effect  samples  the  image  content 
in  the  0X  direction.  This  can  be  described  mathematically  by  con- 
sidering that  the  image  to  be  reconstructed  is  sampled  by  an  array 
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of  delta  ( & ) functions  in  the  ©x  direction.  This  can  be  written 
as , 

comb(-fr)=-2_  S ( ©* - n e«0 


h-  -»o 


(33) 


where  0*  is  the  continous  variable  and  the  O^is  the  sampled  posi- 
tions. Hence  we  can  write, 


_^/^s  ( ©x)  - comb  ^ ^47 CQx) 


(34) 


where 0x ) represents  sampled  reflectivities  along  0X . If  we 

make  the  assumption  that  the^/O  is  bandlimited  (i.e.  limiting  the 

highest  frequency  component  to  be  resolved) , then  it  can  be  shown 
(4) 


that 


n- -ao 


(35) 


This  means  that  the  spectrum  of ^yOs(  ©x  ) can  be  found  by  erecting 
the  true  spectrum  of  ^yO  ( 0*  ) about  each  point  (n/  0X<(  ) in  the 

direction.  As  the yO  is  assumed  to  be  bandlimited,  its  spectrum 
is  nonzero  over  only  a finite  region  of  frequency  space.  It  can 
also  be  shown  that  in  order  to  recover  the  image  exactly,  (within 
the  bandlimited  assumption) , then  it  is  necessary  to  have. 


Ox  - X 


B, 


(36) 


where  B represents  the  highest  frequency  component  to  be  recovered 
x 

It  is  our  intention  to  attempt  to  "recognize"  rather  than  to  recover 
the  image  exactly.  As  a result,  less  sampling  points  are  required 
and  places  less  restrictions  on  the  data  transmission  system.  The 
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more  we  relax  the  B of  (36),  the  less  sampling  points  are  required. 

x 

If  we  have  only  one  sampling  point,  (i.e.  the  fan  beam  at  one 
location) , then  aliasing  occurs-  false  information  is  retrieved-  in 
the  direction  and  we  have  little  or  no  information  about  the  CjOx 

due  to  the  complete  overlapping  of  the  individual  spectrums  of  J3 
( CO^  ) . As  we  increase  the  number  of  sampling  points,  the  individual 
spectrums  move  apart  in  frequency  space  until  there  is  no  overlap. 

At  this  point,  complete  image  recovery  can  be  obtained  by  injecting 
at  each  sampling  point  (artificially)  an  interpolation  function  given 
by, 

S I ^ 2 Bx  ( Ox  — 8x”] 


2 -"/28x) 


(37) 


We  will  assume  that  the ^0S  ( ) is  a constant  term  equal  to  one 

and  proceed  to  calculate  the  expected  resolution  in  the  Oydirection. 
H.  Calculation  of  the  Expected  Resolution 

Returning  to  equation  (32)  with  = 0,  we  write  that. 


c 


MT 


.sO-e-'Sto) 

= e _e Z(u>y) 

.\€uj  y 


(38) 


In  order  to  relate  this  to  the  detector  contrast  requirements,  we 
note  that  (see  equation  (15)  and  (22)  ) , 


%'  - Nfr'Po  Apll.  Cmt 

T S -r->2- 


(39) 


and  that. 


_ Nd^Apt-n-CBr  ^ 
■B  *15  ** 


(40) 
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Now  from  equation  (21), 


or. 


Cb  - 


\J  . S N R 

*V  <4>s  +•  cJ>'B 


(41) 


R • S N R 


HAot  "fcHT  1-  ir<s'Blr£' 


(42) 


F°r  O3  we  use  the  value  for  clean  water  (-^-3x10  4 master."1)  and 
the  r is  calculated  from  equation  (16)  for  tan  T =45°  and  0 
10°  with  R = 100  meters.  Hence  r = 35  meters  and. 


max 


c, 


lOOPy  ' SNR 


(43) 


V Apt  .VS^Tt: 

The  factor  N PQADt  we  call  Q,  a pseudo  figure  of  merit.  Hence, 


I OO  Py  • SNR. 


QV  Cmt  i-'03tr 


(44) 


18 


If  the  fan  beam  wavelength  is  taken  at  432  nm,  then  2.2x10 

photons/ joule.  If  a typical  power  is  1 watt  and  A is  taken  as  about 

2 ^ 

.01  meter  with  an  interrogation  time  of  10~3  sec.,  a typical  Q 

would  be  about  4.7x10**.  Thus  we  write  that. 


c, 


2X10  SSNR.P>y 


i 


■MT 


■+■  . 03  t* 


(45) 


For  values  of  Vy  > 3 cycles/radian,  T ~ 0 . Then, 


2 X / O • Uy 


For  large  values  of  Vy  , C„T  = e 9,5  Q ( CO y ).  In  order  to  set 
limit  onyO  ( COy  ),  we  will  assume  that  lower  limit  is  .05. 

9 

Cr.^  IO'25MK'Vy 


Hence, 


As  a limiting  case,  for  SNR  = 1,  then. 


IO'2^y 


If  the  A ( COy  ) had  been  set  to  1,  then. 


2'S  X i'o 


In  order  to  compare  this  equation  (38),  we  equate  the  normalized 
CMT ( COy  = 0)  to  CR.  A plot  of  equation  (49)  and  normalized  equation 
(38)  is  shown  in  figure  1.  As  indicated  in  figure  5,  the  resolution 
is  determined  by  the  object  contrast  ratio  (i.e.  nekton)  and  the 
detector  requirements  and  not  by  the  sea  water.  For  this  case  (upper 
limit) , the  spatial  angular  frequency  occurs  at  about  61  cycles/ 
radian  times  the  frequency  contrast  ratio  of  the  nekton.  Since 
1/  6y  , then  Qy *=  16  milliradians  at  100  meters.  This  corresponds 
to  a spatial  resolution  of  about  1.6  meters. 
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I.  Conclusions 


It  is  expected  that  for  nekton  of  low  contrast,  resolution  is 
poor  and  only  nekton  with  high  contrast  markings  (i.e.  striped, 
colored  etc.)  can  be  expected  to  give  decent  resolution.  It  is  to 
be  noted  that  the  contrast  requirements  for  the  detector  goes  di- 
rectly as  R.  A corresponding  calculation  at  50  meters  would  effec- 
tively increase  the  resolution  to  40  centimeters  (8x10  3 radians 
x 50  meters) . 

Additionally,  resolution  can  be  increased  by  increasing  the  in- 
terrogation time  and  hence  increasing  the  Q value.  If  the  interr- 
ogation time  is  increased  to  10  milliseconds,  then  the  CR  require- 
ments are  reduced  to  1/3  of  the  value  at  1 millisecond.  Consequently, 
the  resolution  is  increased  to  about  13  centimeters  at  50  meters. 

Since  the  value  of  AD  that  is  used  to  calculate  Q is  limited,  the 
only  variables  that  affect  the  Q are  PQ  and  t.  Limitations  on  avail- 
able power  and  interrogation  time  requirements  for  data  transmission 
will  ultimately  set  the  upper  limits  of  resolution. 

Because  of  the  great  variability  of  nekton  markings  and  shape, 
exact  calculations  of  resolution  expected  are  quite  academic.  We 
require  a criterion  that  can  be  used  to  indicate  what  constitutes  a 
count  (i.e.  if  the  system  is  to  be  used  to  measure  nekton  populations) . 
The  magnitude  of  the  problem  is  enormous  and  in  the  short  study  we 
can  only  indicate  the  direction  that  any  future  study  should  take. 

It  is  our  belief  that  exact  imaging  is  much  too  limited  to  be  use- 
ful as  a counting  tool  and  hence  we  will  depend  on  pattern  recognition 
as  a possible  method  to  circumvent  some  of  the  difficulties  presented. 
This  means  that  classes  of  nekton  (not  species)  must  be  categorized 
enough  so  that  by  sufficient  sampling  it  can  be  recognized  as  such. 
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III.  ANALYSIS  OF  SHORT  RANGE  IMAGING  REQUIREMENTS 


n. 


i 


i 


* 
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A.  General  Requirements 

As  mentioned  in  section  II,  the  variety  of  the  nekton  presents 
an  enormous  characterization  problem.  In  order  to  make  the  analysis 
somewhat  tractable,  we  have  chosen  two  particular  classes  of  nekton 
for  the  analysis.  The  rationale  for  choosing  these  two  classes  of 
nekton  stems  from  the  belief  (partially  supported  by  experimental  ob- 
servations) that  the  sea's  deep  scattering  layer  (DSSL)  is  predom- 
inantly due  to  (1)  myctophids  or  lantern  fish  and  (2)  shrimp-like 
crustaceans  called  euphausiids  and  sergestids ^ . Nets  towed  at  night 
at  the  surface  of  the  ocean  pick  up  one  to  five  of  these  individuals 
per  cubic  yard  and  as  many  as  20  per  cubic  yard. 

Representatives  of  these  two  classes  of  nekton  are  shown  in  figure 
6.  These  animals  vary  in  length  from  one  inch  to  three  inches.  Charac- 
terization of  the  myctophids  is  tabulated  in  appendix  A.  Both  of  these 
animals  have  luminescent  spots  on  their  bodies  called  photophores. 

This  liminescence  has  been  correlated  with  the  diurnal  movement  of 
the  DSSL  and  the  intensity  has  been  measured  to  be  about  5x10"^  micro- 
watts per  square  centimeter  at  474  nm. 

If  the  design  goals  of  a nekton  viewing  system  is  to  produce  a 

2 

system  that  has  an  effective  opening  of  1000  meter  combined  with 
good  spatial  resolution,  then  even  for  a recognition  system,  the  prob- 
lem is  a formidable  one. 

B.  Reassessment  of  Viewing  Design 

Based  on  the  analysis  of  section  II  it  was  found  that  even  for 
high  contrast  nekton  markings  at  100  meters,  the  expected  resolu- 
tion is  on  the  order  of  25  cm.  As  we  are  dealing  with  animals  with 
sizes  on  the  order  of  2 to  7 eras,  in  length,  recognition  is  not  pos- 
sible even  with  sampling  techniques.  Consequently,  we  are  forced  to 


reassess  the  viewing  configuration  originally  considered  in  order  to 
produce  a system  that  can  be  used  as  a counting  tool  with  the  req- 
uisite requirements. 

If  we  use  a criterion  that  at  least  10  sampling  points  are  nece- 
ssary to  recognize  crustaceans  (i.e.  about  2mm  resolution)  and  that 

we  require  an  effective  mouth  opening  (viewing  area)  of  about  1000 
2 

meter  , then  we  are  forced  to  consider  a short  range  beam  used  in 
some  circular  fashion  to  produce  the  requisite  viewing  area. 

If  a system  can  be  devised  that  meets  these  two  requirements,  then 
the  system  will  automatically  be  suitable  for  the  larger  nekton  re- 
sponsible for  the  DSSL.  Each  requirement  will  be  examined  below. 

C.  Resolution  Analysis 

Based  on  the  contrast  requirements  described  in  section  II  we 
found  that  the  limitation  on  contrast  was  due  to  the  detector  require- 
ments and  not  the  sea-water.  As  we  are  now  considering  shorter  ranges 
(on  the  order  of  20  meters) , we  can  neglect  the  sea-water  scattering 
using  the  values  stated  in  sectionll.  This  can  be  seen  from  the  fact 
that  sT  = .005  meter  . With  a round  trip  distance  of  40  meters,  the 

_ o 

total  scattered  energy  from  the  beam  is  e ' or  about  18%.  As  this  is 
the  total  scattering,  it  is  expected  that  less  than  10%  is  in  the  to- 
ward direction.  As  a result,  the  imaging  equations  can  be  simplified 
considerably  from  the  ones  given  in  section  II. 

Again  considering  a fan  beam  with  a fan  angle  of  about  20°  (.35 

radians  )the  total  power  in  the  beam,  P , is  spread  out  into  a rec- 

o 

tangle  of  negligible  width  (about  1 cm,)  and  a length  of  .35R.  Then 

2 

the  power  density  at  the  distance  R is  about  286  PQ/R  (watts/  meter  ) . 
If  we  assume  a uniform  attenuation  ( using  an  = .05  meter  ^) , then, 
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P'=  JP_-  &-DSR2  9<,Po 

M>  R.  (50) 

Consequently,  this  represents  the  irradiance  function  similar  to 
equation  (3).  Equation  (50)  becomes  the  radiance  function  when  di- 
vided by  TT  and  multiplied  by  the  area  over  which  reflection  takes 
place,  then. 


Pl=  B = 2Sfoe"oSRT lRzy>(e) 


where, 


= angular  radius  of  reflective  resolution  element 
/0(€)  = reflectivity  from  region  of  angular  radius 
JCL  = solid  angle 

The  corresponding  background  radiance  is  similarly  given  by. 


Bb  = 2 e-oSBP.k^At£) 


However,  from  section  II, 


can  be  written  as. 


= -it  tsi  i- 


(53) 


where , 

C5b=  the  backscattering  coefficient 
r = effective  distance  through  which  the  resolution  element 
is  viewed 

In  travelling  the  distance  to  the  detector,  both  the  B and  BB  are 

-.05 

further  attentuated  by  e (here  we  assume  that  the  target-source 

distance  and  detector  distance  are  the  same) . The  effective  signal 
received  by  the  detector  system  per  resolution  element  is  just, 
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where, 

Ad=  area  of  collecting  optics 
t = integration  time 

and  also  that. 


13  = Bb  Ad^1  e 

-R2- 


-oS 


The  signal  to  background  radiance  ratio  becomes  just. 


(54) 


(55) 


■S.  ^ — 

"B  TT  cSb 


(56) 


-4 , -1  


For  typical  clean  water  with  a value  ofcs^about  3x10  meter-1  steradian 
and  a value  of  r on  the  order  of  a few  cms.,TT  CJ^r  is  about  10  Con- 
sequently, we  can  neglect  the  background  radiance  for  values  of^O  great- 
er than  .01.  Hence,  we  can  write  that  the  incoming  signal  per  resolu- 
tion element  of  the  object  is. 


c.-  2 8fee~  IRB,'Re2/>Al>t’ 


or. 


-,lRp  ^2. 

- __  28fa  e *o 

“ — o 


Act 


(57) 


(58) 


If  we  call  P A_ t , M,  a figure  of  merit,  then, 
o u 


(59) 
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For  PQ  = 1 watt,  AD  = .01  meter2  and  t = 10  milliseconds,  then, 


s = • ° 3 


( ~ G 2 ^ TOULJ^ 


For  a typical  photodiode  array,  the  leakage  current  is  on  the  order 

of  1/3%  of  the  saturation  value  for  a line  scanning  time  of  10  milli- 

(6)  2 
seconds  . A typical  saturation  value  is  about  1 micro joule/cm  or 

-9 

about  10  joules/resolution  element.  As  a result,  for  a signal  to 
noise  ratio  of  1,  the  signal  required  for  detection  is  on  the  order 
of  3x10  joules/resolution  element.  Hence  equation  (60)  becomes. 


io- 


R e 


This  indicates  that  the  detection  depends  on  the  product  of  reflec- 

2. 

tivity  and  angular  resolution  squared.  A plot  of against  R is  shown 
in  figure  7.  The  corresponding  value  of  6 for  a given yO  can  be  read 
off  the  curve  of  figure  8.  For  example,  at  17.5  meters, = 10-8 
from  figure  7.  For  a = 0.1,  the  £ = 3.2x10  4 radians  or  a spatial 
resolution  of  1 cm.  At = 1.0,  the  corresponding  resolution  would 
be  .3  cm.  Hence,  the  curves  of  figures  7 & 3 can  be  used  to  predict 
the  short  range  spatial  resolution  for  a given ^0  and  R.  It  is  noted 
in  passing  that  this  derivation  was  based  on  negligible  scattering 
and  is  valid  for  a range  of  a few  attenuation  lengths.  Further,  it  is 
noted  that  the  curves  are  for  a S/N  of  1 and  good  recognition  would 
require  a higher  S/N.  In  addition,  as  it  was  assumed  that  the  fan 
beam  width  remains  constant  throughout  the  range  at  1 cm. , the  max- 
imum resolution  of  interest  is  £.  = 2x10  4 radians  at  20  meters  or 
a spatial  resolution  of  about  4 mm  in  object  space. 
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D.  Recognition  Requirements 

The  preceeding  analysis  indicates  that  for  the  fan  beam  under  con- 
sideration, we  must  limit  the  range  to  something  on  the  order  of  20 

-4 

meters  with  an  angular  resolution  of  2x10  radians  or  better. 

If  we  are  required  to  recognize  the  small  crustaceans  ( about  2 cm.) 
in  designing  a viewing  system,  then  we  must  establish  the  minimum  re- 
solution necessary  for  recognition. 

As  recognition  of  an  object  is  a trained  subjective  response,  it 
becomes  difficult  to  state  quantitively  what  constitutes  recognition. 

In  addition,  the  constraint  of  producing  a large  sampling  area  runs 
counter  to  the  resolution  requirements.  The  information  necessary  for 
proper  recognition  is  less  if  a human  observer  is  used  than  if  a com- 
puter is  used.  However,  to  obtain  some  idea  of  what  can  be  recognized, 
we  will  assume  that  an  object  can  be  recognized  as  such  if  we  sample 
at  least  10  areas  of  the  object  along  any  demension  ( i.e.  the  object 
is  to  be  reconstructed  from  only  10  resolution  elements) . This  corres- 
ponds to  at  least  2mm  resolution  for  the  smallest  crustacean.  In  terms 

/i  - 4 _ c. 

of  c , this  will  range  from  10  radians  for  10  meters  to  5x10  rad- 

— Q 

ians  for  20  meters.  For  10  meters,  //c.  (figure  7)  is  about  3x10  . Hence, 

2.  — 8 

yO  must  be  . 3 or  greater  for  recognition.  For  20  meters  is  1-5x10 

or  ^/O  must  be  6.0  or  greater  which  is  not  physically  possible.  At  15 
meters,  the  values  are y<2€2equal  to  6xl0-9  with  £ equal  to  e.STxlO-'1 
from  which jD  must  be  1.50  or  greater  which  is  also  not  physically  pos- 
sible. Hence,  we  conclude  that  for  proper  recognition  of  2cm.  crustaceans, 
the  range  must  be  limited  to  about  14  meters  for  unit  reflectivity.  As  it 
is  believed  that  the  reflectivity  is  on  the  order  of  50  %,  this  further 
restricts  the  range  to  about  12  meters. 

In  order  to  satisfy  the  requirement  of  large  sampling  area,  this  would 
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suggest  that  the  only  way  to  achieve  this  is  to  have  a circular 

scan  arrangement  with  a radius  of  12  meters  producing  an  effective 

2 

sampling  area  of  about  400  meters  . This  does  not  meet  the  desira- 

. . • 2 
bility  of  a sampling  area  of  1000  meters  as  it  is  limited  by  the 

size  of  the  crustaceans  to  be  recognized,  their  reflectivity  and 
the  detector  requirements. 

E.  Suggested  Scanning  Arrangement 

Based  on  the  above  analysis,  it  is  suggested  that  a fan  beam  of 
about  20°  angle  be  used  coming  from  the  tip  of  the  towed  fish  using 
fiber  optics  for  the  coupling.  The  fan  beam  can  be  stepped  every  10 
millisecond.  A total  time  of  90  milliseconds  would  result  for  a com- 
plete circular  scan.  In  addition,  if  the  towed  fish  is  moving  at 
1 knot  meter/sec.),  then  the  circular  fan  beam  is  effectively 
sampling  every  5 cm.  The  width  of  the  beam  could  be  doubled  to 
compensate  partially  for  this  with  a loss  of  power  density  of  a fac- 
tor of  2.  The  looking  time  could  be  decreased  to  5 milliseconds  so 
that  the  sampling  overlaps  slightly  during  each  revolution.  The 
system  is  depicted  diagramatically  in  figure  9.  The  viewing  system 
would  have  to  move  synchronously  with  the  stepping  fan  beam.  With 
such  a system,  the  sampled  volume  would  be  about  200  mcterVscc. 
Based  on  our  previous  report  on  the  expected  density  of  fish  (10/ 
meter  ) , this  would  correspond  to  about  2000  counts/sec. 

In  section  IV,  we  examine  some  of  the  myctophid  characteristics 
that  might  be  suitable  parameters  for  pattern  recognition. 
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IV.  GEOMETRIC  AND  B IOLUMINESCENT  CHARACTERIZATION  OF  MYCTOPHIDS 

A.  Statement  of  the  Problem 

In  the  previous  two  sections  we  have  established  the  following 
as  necessary  for  a viable  deep  water  imaging  system  for  counting 
nekton : 

1.  The  electro-optical  system  is  to  be  used  to  count  nekton  of 
grossly  different  morphology  only  (i.e.  no  differentiation 
of  species) 

2.  The  euphasiids  and  the  myctophids  represent  the  lower  limit 
of  the  imaging  system  in  terms  of  size  and  reflectivity 

3.  The  imaging  system  must  operate  at  relatively  close  range- 
on  the  order  of  20  meters-  in  order  to  properly  image  the 
nekton  of  2 

4.  In  order  to  acheive  the  largest  possible  sampling  volume, 

the  illuminating  beam  should  be  used  in  some  circular  fashion 

In  addition  to  these  constraints,  it  is  also  necessary  for  any 
viewing  system  to  be  able  to  recognize  and  count  the  variety  of  the 
nekton  present.  Consequently,  a viable  system  must  incorporate  a 
pattern  recognition  hierarchy  capable  of  sorting  and  counting  in  real 
time  the  changing  images  presented  to  the  system.  The  necessity  for 
such  a pattern  recognition  system  cannot  be  overemphasized  as  the 
following  illustrates. 

A typical  school  of  myctophids  may  have  a thickness  of  10  meters 
with  a diameter  of  50  meters.  With  a myctophid  density  of  about  10/ 
meter^,  the  school  represents  about  200,000  myctophids.  Assuming  that 
the  viewing  system  is  travelling  parallel  to  the  diameter  of  the 
school  at  *5  meter/sec.  (about  1 knot)  , it  would  take  the  viewing 
system  about  100  sec.  to  traverse  the  school  of  myctophids. 


The  system  must  be  capable  of  counting  and  recognizing  myctophids 
at  the  rate  of  2000/sec.  This  is  an  enormous  task  unless  the  sys- 
tem is  programmed  to  recognize  and  count  in  a prescribed  manner. 

As  the  nekton  at  rest  are  normally  horizontal  or  slightly  oblique 
but  in  any  orientation,  the  pattern  recognition  hierarchy  must  be 
able  to  recognize  the  prescribed  shapes  and  sizes  in  any  orientation. 
This  problem  is  an  order  of  magnitude  more  difficult  to  accomplish 
than  the  pattern  recognition  techniques  used  presently  in  micro- 
scopic image  analysis  where  all  objects  to  be  recognized  are  restrict- 
ed to  a plane. 

It  is  noted  in  passing,  that  the  pattern  recognition  hierarchy  is 
necessary  whether  acoustic  or  optical  imaging  imaging  is  used. 

B.  Characterization  of  the  Myctophid  Family  by  Size  and  Shape 

Using  the  myctophid  family  of  nekton  as  a model  (lantern  fish), 
we  wish  to  develop  a unique  characterization  that  can  be  recognized  by 
a suitable  optical/computer  system.  We  consider  the  following  para- 
meters as  a means  of  developing  a geometric  characterization  of  these 
nekton : 

1)  Length:  3.5  to  13  cm. 

2)  Shape: 

a.  Side  on:  fusiform  (spindle  shaped  at  both  ends) 

b.  End  on:  flat-sided  flanks  (ellipsoidal  cross-section) 

3)  Speed:  10  cm/sec.  maximum  (sluggish  swimmers) 

4)  Vision:  maximum  absorption  about  480  nanometers 

5)  Bioluluminescence : characteristics  to  be  described  in  C below 

6)  Area:  app.  . 1L  (described  below) 

7)  Pseudovolume:  reflectivity  times  area 

8)  Perimeter:  app.  2 . 1L  (described  below) 

The  characterization  we  are  attempting  to  develop  must  be  able  to 


distinguish  the  myctophid  family  of  nekton  found  in  the  mesopelagic 
zone.  We  are  only  considering  for  this  work  side-on  views  in  any 
orientation.  The  more  difficult  problem  of  "in  depth"  orientation 
will  be  pursued  at  a later  time. 

The  model  we  are  using  for  characterization  is  shown  in  figure  10. 
Due  to  the  silvery  sides  of  this  nekton,  an  imaging  system  will  pro- 
bably not  be  able  to  distinguish  the  fins  or  tail  (due  to  difference 
in  reflectivity) . Consequently,  the  image  presented  to  the  computer 
system  will  be  one  of  uniform  intensity  outlined  against  nearly  black 
water.  As  a first  cut,  we  section  the  lantern  fish  as  indicated  in 
figure  11.  The  numbers  are  cast  in  terms  of  its  length.  From  this 
model  we  arrive  at  the  following  parameters  compared  to  a uniform 
circle  of  diameter  L,  of  unit  reflectivity  and  a line  of  length  L 
of  unit  reflectivity. 


Line  (R=l) 

Uniform  Circle  (R=l) 

Myctophid 

P (Perimeter) 

app.  2L 

3.14L 

app.  2 . 1L 

A(Area) 

8 xL 

qt2 

app.  . 8L 

, 2 

app . . J L 

V(Pseudovolume)  8 xL 

2 

app.  . 8L 

app.  Rx.lL 

where  <5  = delta  function  of  thickness  approaching  zero 

As  can  be  seen,  the  perimeter  has  a range  of  2L  toTTL;  the  area 

r 2 c 2 

a range  of  o L to  . 8L  and  the  pseudovolume  a range  of  6 L to  . 8L  . 

No  single  parameter  is  useful  for  characterization  as  many  mesopela- 
gic nekton  have  parameters  not  too  different  from  the  myctophids. 

If  we  examine  non-demens ional  combinations  of  the  above  parameters, 

2 

we  have  shape  information  from  P /A  and  density  information  from  A/V . 

Line  Myctophids  Circle 

Shape  (P2/A)  4L/&2  ~ ao  app.  44  app.  15.4 

Density  (A/V)  1 1/R  1 

A combination  of  density  and  shape  characterization  appears  to 
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give  a clearer  seperation  than  the  single  parameters  do.  Consequently, 
the  measurement  of  P,  A and  R simultaneously  and  conversion  to  shape 
and  density  parameters  seem  necessary  to  uniquely  chracterize  the 
myctophids.  For  example,  hatchet  fish  would  characterize  closer  to 
a circle  than  myctophids  while  the  stomiatoids  would  chracterize 

J I 

closer  to  a line.  Although  length  is  a parameter,  by  itself  is  not 
enough  of  a discriminant.  Shape  and  density  characterization  are 
necessary  to  recognize.  Of  course,  to  determine  the  uniqueness  of 

1 

this  type  of  chracterization,  this  type  of  analysis  must  be  performed 
for  every  family  of  nekton  expected.  However,  it  appears  that  geo- 
metric characterization  by  itself  is  not  enough  of  a discriminant 
for  a practical  recognition  system.  Geometric  characterization 
combined  with  perhaps  bioluminescence, which  is  described  below, 
might  provide  the  unique  signature  for  a computer  recognition  sys- 
tem. 

C.  Characterization  of  Bioluminescence 

Characterization  by  bioluminescence  is  being  considered  as  it  pre- 
sents the  possibility  of  recognizing  "species"  of  myctophids.  This 
stems  from  the  fact  that  each  species  has  developed  its  own  spatial 


arrangement  of  photophores.  An  optical/computer  system  programmed  to 
recognize  according  to  the  spatial  arrangement  of  the  photophores 
could  in  principle  count  species  of  myctophids.  This  is  strengthened 
by  the  belief  that  myctophids  have  the  ability  to  recognize  members 
of  their  own  species  from  the  photophoric  arrangement.  In  figure  12 
is  depicted  the  spatial  arrangement  of  the  photophores  of  5 species 
from  the  myctophid  genus  Diaphus.  As  illustrated,  even  though  the 
photophoric  arrangement  is  similar,  they  are  not  exactly  the  same. 
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In  addition  to  the  photophoric  arrangement,  a second  discriminant 
is  available  for  use  in  recognition  consisting  of  the  frequency  of 
bioluminescent  flashing.  Although  less  is  known  about  this  aspect  of 
bioluminescence,  it  should  provide  a discriminant  against  sunlight 
scattered  background  when  designing  a system.  Further  inputs  are  re- 
quired from  the  marine  biological  community  in  order  to  assess  this 
parameter  as  a means  of  recognition. 

In  order  to  design  a system  that  can  use  bioluminescence  as  a 
parameter  in  its  recognition  system,  an  estimate  is  necessary  of  the 
intensity  level  of  bioluminescence  that  can  be  expected  from  indivi- 
dual lantern  fish. 

Two  approaches  are  utilized  in  trying  to  arrive  at  an  estimate  of 
the  individual's  bioluminescent  intensity. 

1)  Estimate  Based  on  Scattered  Background 

Bioluminescence  in  the  twilight  zone  may  take  the  place  of 
countershading  in  surface  waters.  If  the  intensity  of  a fish's  belly 
lights  matches  the  intensity  of  sunlight  filtered  into  the  twilight 
zone,  the  fish  will  create  silhouette  nor  shadow  when  seen  from  be- 
low. If  lantern  fish  use  this  mechanism  to  reduce  their  visibility 
to  predators,  then  an  estimate  can  be  made  of  the  intensity  of  bio- 
luminscene  by  equating  it  to  the  filtered  sunlight  background  in  the 
twilight  zone. 

The  depth  of  the  twilight  zone  is  determined  by  the  surface  il- 
lumination of  the  sun  or  moon.  Echograms  taken  off  of  San  Diego ^ ^ 
indicate  the  following  scenario.  An  hour  before  sunrise,  the  various 
organism  of  the  deep  scattering  layer  (DSL)  begin  their  descent.  The 
myctophid,  the  most  sensitive  to  light,  generally  start  down  first 
because  they  must  dive  to  the  darkest  depths.  A short  time  later  the 
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second  layer,  believed  to  be  the  euphasiids,  takes  form  and  settles 
and  soon  to  be  followed  by  a third  layer  believed  to  be  composed 
of  sergestid  shrimps.  The  layers  never  cross,  indicating  that  each 
family  of  the  DSL  seeks  its  own  level  of  illumination.  Diving  at  speeds 
of  25  feet  per  minute,  the  scatterers  are  at  least  halfway  to  their 
ultimate  levels  at  sunrise.  Within  an  hour  after  sunrise  they  attain 
their  preferred  depth.  As  the  sun  approaches  zenith,  they  sink  a bit 
lower  to  their  maximum  depth. 

The  level  sought  by  each  organism  apparently  seems  to  depend  on 
the  organism's  sensitivity  to  light.  In  a bathyscaph  dive  off  of 
San  Diego , there  were  no  large  organisms  found  between  850  to  1200 
feet.  Between  1200  to  1500  feet  deep-sea  prawns  were  seen,  so  many  in 
fact,  that  they  could  not  be  counted.  In  the  next  200  feet  a large 
number  of  lantern  fish  were  encountered.  From  1700  feet  to  2150  feet, 
there  were  relatively  few  large  organisms;  however,  from  2150  to  2300 
feet  a large  concentration  of  what  were  apparently  lantern  fish  were 
observed.  In  another  dive,  there  was  an  abrupt  change  in  water  clarity 
at  2100  feet  described  as  crystal  clear. 

In  addition,  it  has  been  observed ^ that  bright  moonlight  holds 
the  DSL  at  shallow  depths  although  what  is  meant  by  shallow  depths  is 
not  quantified  in  the  reference. 

In  order  to  arrive  at  some  estimate  of  bioluminescence,  we  could 
take  the  level  of  illumination  at  each  depth  and  equate  it  to  the 
exponential  decay  of  light  through  clear  ocean  water.  However,  level 
of  illumination  is  characterized  in  terms  of  human  cone  vision  (light 
adapted  eye)  while  the  fish  response  is  in  term  of  their  own  vision 
different  from  man's.  Consequently,  in  order  to  relate  the  above 
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scenario  to  the  subjective  response  of  fish  vision,  we  must  recast  the 
known  levels  of  illumination  at  various  times  of  the  day  or  night  in- 
to illumination  values  as  the  fish  "sees  it". 

The  problem  can  be  simplified  if  we  assume  that  the  source  of 
illumination  (e.g.  sunlight,  moonlight  and  starlight)  can  be  charact- 
erized as  a white  light  source  (i.e.  uniform  intensity  per  unit  wave- 
length) . For  noonday  sunlight  this  is  approximately  true  while  star- 
light and  moonlight,  at  least  over  the  wavelengths  of  interest,  can 
also  be  characterized  as  "white". 

The  defining  equation  for  subjective  response  given  the  radiance 
of  a source  in  objective  (e.g.  watts/cm  micron)  can  be  written  as, 


o/=  V E>  / KAd> 

/ A (62) 

A, 

where  subjective  response  (lumens/cm2) 

V = conversion  factor  (lumens/watt) 

2 

Ex=  radiance  of  source  (watts/cm  micron) 

K^=  Visibility  curve  (normalized  to  1.00  at  peak  sensi- 
tivity) 

For  man,  two  kinds  of  response  are  recognized;  the  cone  vision 
(light  adapted  eye)  and  rod  vision  (dark  adapted  eye).  For  most  fish 
there  is  only  one  kind  of  vision,  namely,  rod  vision.  For  man  we  have 
the  following  values  for  V^. 

V(cone)  = 680  lumens/watt  @ 555  nanometers 
V(rod)  = 1724  lumens/watt  @ 513  nanometers 
In  order  co  obtain  a value  of  V for  fish,  we  note  that  it  has 
been  determined  that  the  density  of  retinal  rhodopsin  for  man  is  about 
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.15  while  for  midwater  fish  it  is  greater  than  1.0.  Although  estimates 
of  light  absorbed/cm  of  retina/sec  has  been  put  at  15  to  30  times 
greater  for  fish  than  humans,  we  take  a conservative  estimate  of  12 
times  for  this  evaluation  and  take  V(fish)  at  about  20,000  lumens/watt 
at  480  nanometers. 

The  next  step  in  this  conversion  process  is  the  evalution  of 
in  equation  (62),  For  man's  cone  vision  it  is  .1068  microns  and  for 
man's  rod  vision  it  is  .0891  microns^.  We  assume  that  the  general 
shape  of  the  fish  visibility  curve  is  similar  to  man's  rod  vision  with 
a peak  at  480  nanometers  instead  of  513  nanometers  and  extends  from 
480  to  550  nanometers  instead  of  400  to  650  nanometers.  The  two  curves 
used  for  this  evaluation  is  shown  in  figure  13.  If  we  take  the  limit 
of  man's  cone  vision  as  400  to  700  nanometers,  we  note  that  the  equiv- 
alent width  of  the  visibility  curve  is  .1060  microns/. 3 microns  or 
35.6%  of  the  limits  of  vision.  Similarly,  for  man's  rod  vision  it  is 
about  .0891/. 25  or  35.6%  of  the  limits  of  vision.  If  the  visibility 
curve  of  fish  vision  is  similar  to  man's  we  have  that  the  equivalent 
width  is  .356 (.15)  or  about  .053  microns. 

We  are  now  in  a position  to  estimate  X for  fish  according  to 
equation  (62) . Based  on  the  response  of  midwater  fish,  they  are  found 
grazing  at  the  surface  of  the  water  when  there  is  no  moonlight.  For 
a clear  starlight  night,  the  level  of  illumination  on  a horizontal 
surface  is  about  3xl0~8  phot  ^ (lumens/cm2)-  rod  vision  (man),  (rod 
vission  occurs  when  the  eye  becomes  adapted  to  a field  luminance  below 


10  2 candles-'m2  for  at  least  30  minutes  ^ 


From  equation  (62)  we 


have  that. 


3 X 1 0"  8 Cr 


ExO-i^  -~T0 55>  = 2 x lo"  WXTTVU> 
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For  fish  vision  this  level  of  irradiance  produces, 

of  Cfi*h)  ~ 2 X IO  4<2  X I0‘,0)(.0ff3)=r  Z X IO'7  Lumens^*  (g4) 

We  could  call  this  fish-lumens  or  ichthylumens  to  indicate  fish  re- 
sponse but  will  retain  the  term  lumens  and  just  indicate  when  it  ref- 
fers  to  the  fish  vision  response.  It  is  noted  that  compared  to  man's 
rod  vision,  the  fish  vision  response  is  only  approximately  7 times 
greater  than  man's  due  to  the  narrower  vision  bandpass.  As  we  will 
discover  below,  this  changes  dramatically  in  deep  water. 

In  deep  water,  due  to  the  spectral  attenuation  of  sea  water,  in 
order  to  use  equation  (62) , we  would  have  to  move  the  E ^ under  the 
integral.  To  avoid  this  complication,  we  note  that  in  deep  water,  the 
resultant  radiance  becomes  very  monochromatic  with  a peak  at  about 
480  nanometers.  Based  on  the  measurements  made  by  the  DOOM  project 
a change  of  only  10%  in  o(  with  wavelength  will  produce  a monochromatic 
radiance  confined  to  480  - 10  nanometers.  Consequently  we  can  treat 
the  E ^ as  still  constant  over  this  bandpass. 

Referring  to  figure  13  we  have  graphically  intergrated  a 20  nano- 
meter bandpass  over  both  the  fish  visibility  and  man's  rod  visibility 
curves  with  the  result  that  for  fish  vision  the  equivalent  width  is 
about  .02^6*  while  for  man's  rod  vision  it  is  about  .013  ^4^.  . As  fish 
are  at  their  greatest  depths  for  a zenith  sun,  the  E ^ to  use  in  equa- 
tion (62)  is  the  radiance  due  to  noonday  sunlight.  Terrestrial  sun- 
light has  a radiance  value  on  a horizontal  surface  of  about  .15  watts/ 
cm2  micron  . Consequently, 

Caxio^Coa}  e (55) 
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— attenuation  coefficient  for  sea-water  at  480  nanometers 
= depth 

c*^Y-pish)  =.  ^06  (Lumens/cMJ) 

(66) 

Similarly  for  man's  rod  vision, 

C^(man)  =r  3.3  (o  e~  (Lomens/cM1)  (67) 


where  O/, 


or, 


As  can  be  seen, fish  vision  is  now  about  18  times  as  sensitive 
as  man's  vision  for  filtered  sunlight. 

We  now  equate  equation  (64)  to  equation  (66)  as  it  is  known  em- 
pirically that  fish  can  tolerate  this  level  of  illumination.  Hence, 


<2  x io 


-7 


4o  e 


CVo'R. 


(68) 


0(o"R.  -=  iq.5Z  (69) 

max 

This  indicates  that  the  maximum  will  be  determined  by  (V0', 

the  average  attenuation  coefficient  at  480  nanometer.  For  typical 

ocean  water,  neglecting  the  surface  attenuation,  O^j^.05  meter  ^ . 

From  equation  (69)  Rmax  becomes  about  390  meters.  For  clearest  ocean 

water  (y  ^ .033  with  R = 590  meters.  Consequently,  midwater  fish, 

o max 

based  on  this  analysis,  should  be  found  between  1300  to  2000  feet 
during  the  daytime.  This  correlates  well  with  the  observations  made 
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from  the  bathyscaph.  This  analysis  also  explains  why  moonlight  will 
drive  the  fish  into  shallow  depths.  An  estimate  of  the  depths  reached 
can  be  made  by  taking  the  equivalent  width  as  .04  microns  instead  of 
.02  microns.  A full  moon  produces  an  illumination  of  about  1.6xl0-5 
phot  (cone  vision) . Hence, 


( moon  l**}  ht) 


I 6>  X IQ"5 

68oCiofc8) 


3.2.  X IO'  j;jATT5_ 


CM1 


(70) 


and. 


O^tah-moonl^hO  - J 2 XlO-7(2XlO4)604)e 


(71) 


or. 


0^'C4>sh-mn0onlic|K"t)  — (•*$  X IO  C 


(72) 


Again  equating  to  equation  (64)  we  have. 


2X  IO  7 = J.  8 x icr^e 


-4^-<Xo“R 


(73) 


or. 


(Vo — £> . 8 O (74) 

Typically  for  surface  waters,  O(0  0.15  and  R becomes  45  meters. 

For  0<o=  .10,  R=  68  meters.  Consequently,  moonlight  can  drive  the 
fish  a couple  hundred  feet  below  the  water's  surface. 
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In  order  to  complete  the  scenario,  we  now  estimate  the  range  of 
illumination  that  the  midwater  fish  can  tolerate.  It  was  stated  above 
that  lantern  fish  do  not  begin  their  descent  until  an  hour  before 
sunrise.  The  level  of  illumination  1 hour  before  sunrise  is  depen- 
dent on  latitude  and  time  of  year.  For  example,  for  middle  latitudes 
and  June  21,  the  solar  depression  angle  is  about  7°^^).  por  this 
depression  angle,  the  illuminance  on  a horizontal  surface  is  about 
10  ^ phot  (cone  vision)  ^ . Again  from  equation  (64), 


£ v - — 19. — - = 1-4  X IO~k.^ATTj>_ 

to  20  C cMy 


For  fish  vision  this  becomes  for  shallow  water, 

c/C-tish)  = I.  4 x io_fc(2xio4)C-o4)  e_c*°^- 

|.|  X (Lorvte^s/cM1) 


-?e-Xo'R  (l 


urr\e<r\S  , 


Since  the  exact  lighting  conditions  are  not  given  in  reference15* , 
we  must  assume  that  1 hour  before  sunrise  is  near  moonset  and  the 
lantern  fish  were  in  shallow  water  before  they  started  their  descent. 
Using  the  value  of  o/0"R.  in  equation  (74)  we  have  that, 

SC = I I * IO~  e (LoryienS/cM*-; 


= |.l  XIO"4  (Umens/cHi) 
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This  result  is  independent  of  depth  and  only  presumes  that  the 
equivalent  width  for  the  fish  eye  visibility  is  about  .04^c  . This 
indicates  that  the  lantern  fish  can  tolerate  at  least  10  times  the 
normal  lighting  conditions,  presumably  due  to  the  time  required  for 
their  eyes  to  accomodate  to  changing  light  conditions  similar  to  man's 
vision. 

If  the  above  analysis  correctly  accounts  for  the  observed  scenario 
of  lantern  fish,  then  we  can  conclude  that  the  level  of  illumination 
at  equilibrium  equals  at  least  the  level  of  their  bioluminescence. 
Therefore  at  great  depths  we  have  that. 


£ - . [5  (.02)  (wnns/cM1) 


(79) 


Since  o(9r  = 19.52  from  equation  (69);we  have  that  the  intensity  of 
their  bioluminscence  per  animal  is  about  10  watts/cm^  or  10  yu_ 
watts/cm2  at  480  nanometers  with  a bandpass  o f ± -Ol/t. 

The  results  of  this  anlysis  are  collected  and  shown  in  Table  1 
for  convenience. 

2 Measured  Bioluminescence 

During  the  diurnal  migration  of  the  scattering  layer  in  deep 
water  adjacent  to  the  Canary  Island,  the  layer  was  shown  to  closely 
follow  the  isolume  of  5x10  ~v  W/cm2  at  474  nanometers.  In  addition, 
the  layer  did  not  begin  their  descent  until  about  1 hour  before  sun- 
rise where  they  were  in  shallow  waters  at  about  100  meters  due  to 

moonlight.  Although  this  was  not  measured  from  a single  animal  but 

5 

a school,  the  measurements  correlates  well  with  our  estimate  of  10 - 

2 

watts/cm  per  animal. 
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has  measured  the  luminescence  of  a number 


In  addition,  Nicol^^ 
of  animals  and,  for  long  lasting  flashes,  he  gives  values  ranging  from 
•*.  10-^to  2x10”^^^.  W/cm^on  a receptor  surface  placed  lm  from  the  source 

and  normal  to  it.  For  a single  animal  approximately  1x5cm,  and  assuming 
diffuse  radiation,  the  radiance  is  about  s/r  xlO^/4  W/steradian  using 
our  estimated  value  of  luminescence  . A receptor  1 meter  away,  assuming 

__  Q 

a point  source  of  radiation,  would  produce  an  irradiance  ofj£xl0  M- 

7T 

2 . ... 

W/cm  . This  is  close  to  the  lower  limit  given  by  Nicol.  As  it  is  not 

indicated  whether  the  radiance  measured  was  from  a single  animal  or  a 

group,  we  conclude  that  our  estimate  is  a reasonable  one.  Consequently, 

in  future  analyses  , we  will  retain  the  value  of  10  y*-  W/cm  per 

animal  when  estimating  sensitivity  requirements  for  detection. 
f 
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V.  OPTICAL  PATTERN  RECOGNITION 


A.  Background: 

Although  the  orginal  intent  of  this  program  was  to  develop  a 
recognition  system  utilizing  a computer  recognition  scheme,  it  has 
become  apparent  during  the  course  of  this  work  that  such  a system 
will  not  meet  the  design  criteria  of  a viable  recognition  and  count 
ing  system.  This  change  in  direction  is  the  result  of  the  following 
requisite  characteristics  of  a recognition  and  counting  system: 

(a)  due  to  the  increased  costs  of  available  ship  time,  a towed 
fish  must  move  more  rapidly  to  gather  more  data  in  a shorter  time 
than  originally  envisioned  (i.e.  from  1 knot  to  10  knots). 

(b)  due  to  the  enormous  costs  involved  in  testing  any  counting 
system  in  the  ocean,  it  is  more  desirable  (i.e.  economically  and 
for  purposes  of  calibration)  to  be  able  to  test  a developed  system 
on  a simulator  that  can  reasonably  imitate  the  following  variables 
encountered  in  ocean  testing: 

1)  motion  of  the  towed  fish 

2)  sea  transfer  function  with  range 

3)  orientation  of  nekton 

4)  background  scattering 

5)  attenuation  of  the  sea  water 

6)  detector  characteristics 

7)  bioluminescent  characteristics  of  the  nekton 

The  inability  of  present  day  computer  technology  to  cope  with  re 
quirement  (a)  above  can  be  seen  from  the  following  considerations. 
Assuming  a modest  image  format  of  100x100  image  elements  (i.e.re- 
gardles  of  how  the  image  is  formed) , a relative  motion  between  the 
towed  fish  and  nekton  of  10  knots  (about  500  cm. /sec.)  will  produce 


J 

a smearing  of  each  object  point  or  resolution  element.  A modest  re- 
solution element  in  object  space  for  lantern  fish  is  about  1mm.  To 
minimize  object  blur  and  hence  image  blur,  we  require  the  blur  to 
be  no  more  than  1/10  of  the  resolution  element  or  . 1 mm  to  maintain 

the  image  quality  of  the  static  case.  Taking  a worst  case  situation, 

-5 

we  require  that  each  resolution  element  be  recorded  in  2x10  sec. 

For  a 100x100  image  format,  this  results  in  an  image  being  recorded 

every  2xl0-5  sec.  In  a sequentially  recorded  system,  this  results  in 

0 

a pixel  (i.e.  picture  element)  transmission  rate  of  5x10  /sec.  If  4 

bits  represents  each  pixel  (16  levels  of  grey) , then  we  need  a trans- 
. . 9 

mission  rate  of  2x10  bits/sec.  This  is  well  beyond  the  state-of-the 
art  for  small  systems.  Although  this  is  a worst  case  situation  and 
under  certain  situations  the  rate  is  well  below  this,  if  the  system 
is  to  be  usable  in  the  real  world,  we  conclude  that  sequential  pro- 
cessing cannot  be  used.  Parallel  processing  becomes  necessary  in 
order  to  achieve  the  required  image  quality  under  high  towing  rates. 

This  suggests  that  optical  processing  should  be  used  if  possible. 

Although  optical  processing  is  not  at  the  stage  of  development  that 
image  computer  processing  is,  it  is  sufficient  to  meet  the  requisite 
constraints  for  a viable  counting  system. 

The  second  constraint,  (b)  above,  suggests  the  use  of  optical 
processing  also  for  the  simulator.  As  will  be  shown  below,  proper 
optical  design  will  reasonably  simulate  the  listed  variables  above 
using  incoherent  light. 


B.  Theory: 

1.  Background: 

It  would  take  us  too  far  afield  to  describe  fully  the  theory  of 
of  image  formation  using  the  concept  of  linear  spatial  filter  theory. 
Many  excellent  texts  have  been  written  describing  the  theory.  The 
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text  by  O'Neill'  "'is  the  classic  in  the  field.  We  only  present  here 
the  salient  features  of  the  theory  in  order  to  describe  both  the 
simulator  and  the  optical  image  processing  proposed  for  this  work. 

In  incoherent  light,  an  image  formed  by  any  optical  system  can 
be  considered  to  be  the  convolution  of  the  system  spread  function  s(x) 
(i.e.  response  of  the  optical  system  to  a point  source)  with  the 
object  intensity  distribution  0(6  ).  Here  x and  £ refer  to  two  di- 
mensions. Hence  we  can  write. 


1(a)  = SCO  O 0(e) 


(80) 


where,  I (x)  = resultant  image  intensity  distribution 
o = mathematical  convolution 
Fourier  transforming  (1)  results  in. 


I (to)  = t"  • O CcS) 


(81) 


where,  I(oo)  = image  optical  spatial  frequency  spectrum 
T'(co)  = optical  tansfer  function 
0(co)  = object  spectrum 

CO  = optical  spatial  frequency 

It  is  noted  that  whereas  there  is  a convolution  in  image  space,  there 
is  simple  multiplication  in  frequency  space. 

Since  s(x)  can  be  written  as. 


s(x)  =.  A 00  • A*(x) 


(82) 


where,  A(x)  = amplitude  image  distribution  function 
A* (x)  = complex  conjugate  of  A(x) 

Then,  the  Fourier  transform  of  s(x)  becomes, 
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Z-fco)  :P(W)0  V^CuS) 


(83) 


where,  P(co)  = exit  pupil  function  expressed  in  spatial  frequency  units 
P*(OL>)  = complex  conjugate  of  P(uo) 

Consequently,  the  effect  on  imaging  by  an  optical  system  can  be  mod- 
ified according  to  the  form  of  the  exit  pupil  of  the  system.  The  re- 
sultant modification  on  T-{co ) produces  the  kind  of  image  quality 
formed  in  frequency  space.  The  mathematical  operation  of  convolution 
(autocorrelation  for  a symmetric  function)  for  a symmetric  pupil 
function  is  simply  the  translation  of  the  pupil  function  over  itself. 

In  many  cases,  this  can  be  done  graphically.  For  example,  for  a rec- 
tangular pupil  function,  the  resultant  £"(cO)  is  a linear  decreasing 
function.  For  other  pupil  functions,  more  complicated  (cl>  ) 1 s result. 
2.  Optical  Simulation  Of  Sea  Parameters: 

From  an  economical  point  of  view  and  in  terms  of  calibrating  and 
determining  the  effectiveness  of  a developed  recognition  and  counting 
system,  it  is  desirable  to  be  able  to  simulate  those  parameters  that 
will  be  encountered  in  sea  testing.  Although,  all  the  parameters  can- 
not be  simulated  exactly,  enough  of  the  important  parameters  can  be 
simulated  so  that  the  performance  of  a developed  system  can  be  ex- 
perimentally verified  without  sea  testing. 

(a)  Simulation  of  Uniform  Motion  in  One  Direction: 

It  can  be  shown ^ that  linear  motion  of  the  image  in  one  direction 
will  affect  the  transfer  function  according  to, 

C’Coo*')  — T~0Cco)  sir*  ^COk  (84) 

where,  Z^(co)  = transfer  function  for  static  image 
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L = v times  t 

v = velocity  of  moving  image 
t = integration  time 

From  equation  (83)  the  transfer  function  can  be  represented  by  the 
autocorrelation  function  of  the  pupil  function.  Consequently  we  need 
a representation  for, 

T>(/3)  T**  (fi-COx)  (85) 


For  pure  phase  variations,  that  is  for  P ) = e f a phase 

error  of  the  form  ^ {J$  ) = an^n  produces  an  integrand  in  equation 
(83)  of  the  form. 


P*(f5-wx)  = e (86» 

where,  w = A</)  - ^(JS  -o*)  is  a polynomial  of  degree  n-1  in  . 
For  n = 2,  the  resultant  polynomial  represents  a focussing  error  of 

the  form  *■(£)-  bi  '■P'A  ) 2 where , 


- ^ttol 

XF 


(87) 


with  a the  radius  of  the  pupil,  F,  the  focal  length  of  the  lens  and 
b^,  the  magnitude  of  the  focussing  error  given  by, 


2 Fx 


(8») 


with  &JL  = the  distance  the  lens  is  out  of  focus.  It  can  be  shown 
that  when  b^  is  greater  than  2X,  the  resultant  transfer  function  is. 


= Sin  CoJxd) 

wxd 
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where  2d  is  the  diameter  of  the  defocussed  spot  (geometrical  approx- 
imation) . 

For  b^  greater  than  2^  we  have  that. 


^ 2X 


(90) 


2 F 


or. 


za  > )4>> 


(91) 


where  F..  = f number  of  the  lens.  From  equation  (84) , we  find  the 


equivalence  as. 


L - 2.d 


(92) 


or  L represents  the  diameter  of  the  defocussed  spot  size.  Con- 
sequently, defocussing  in  one  demension  is  optically  equivalent 
to  linear  image  motion  and  the  magnitude  of  L can  be  simulated  by 
the  amount  of  defocussing  through  equation  (91)  . Finally  image 
motion  can  be  related  to  object  motion  by  knowing  the  object  range, 
(b)  Sea  Transfer  Function  With  Range: 


(2) 


It  has  been  shown  by  Wells'  , that  the  transfer  function  for 


sea  image  transmission  can  be  written  as. 


-D^)X 


(93) 


where  im=  decay  function/distance 
R = range 

^ = spatial  frequency  in  terms  of  radians  (frequency) 
per  radians  (angle) . 
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It  has  been  shown  by  Wells  that  for  the  focussed  case, 


D (hO  = * - S-LLz 


4*6, 


(94! 


where  oL  = attenuation  coefficient 
S = scattering  coefficient 

Q,  = characteristic  angle  of  the  volume  scattering  function 
Consequently,  the  sea  scattering  parameters  and  attenuation  can  be 
used  to  determine  the  ( R,V  ) directly.  Calling  C,—e  -^J/Veo.y, 
equation  (94)  becomes  DOP)  = a - sy  or. 


* e-<yR*  esyR 


(95) 


where  O < y < i . When  y=  o , = e~  °*^and  there 

is  no  scattering.  When  Y - 1 > ^^or  G 'Y'^'  where 

Y*  is  the  broad  bean  attenuation  coefficient.  Consequently , 't'CR,  S-0 
at  =.  O is  6 and  decays  exponentially  to  <3  as  ^-^oo. 

In  order  to  simulate  this  function  in  , we  need  an  attenuation 

-yr. 

given  by  0 with  an  exponentially  decaying  function  according 
to  equation  (95).  An  excellent  approximation  to  this  function  can 
be  obtained  optically  by  considering  the  spherical  aberration  of  a 
lens.  From  equation  (86)  and  what  follows  there,  when  h=4we  have 


that 


= c>  w 


(96) 


which  represents  spherical  aberration  at  the  paraxial  focus.  The 


magnitude  of  C^  is  given  by. 


^ L_ 

c‘  =~r# 


(97) 
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where  ^ L.  = distance  between  the  paraxial  focus  and  marginal  focus. 
By  irising  the  lens,  the  value  of  A L can  be  varied  to  simulate 
different  amounts  of  spherical  aberration  and  hence  varying  degrees 
of  exponential  decay.  By  suitably  choosing  the  F and  the  shape 
factor  of  the  lens,  a wide  range  of  the  sea  transfer  functions  can 
be  simulated  in  a continous  fashion. 

(c)  Orientation,  Background  Scattering  And  Attenuation: 

Orientation  is  simply  accomplished  by  object  rotation,  while 

background  scattering  is  introduced  seperately  as  background  light 
and  attenuation  is  simulated  by  crossed  polarizers  in  the  system. 

(d)  Detector  Characteristies : 

In  the  above  analysis  it  was  tacitly  assumed  that  the  image 
resolution  was  controlled  by  the  transfer  function.  Under  conditions 
of  weak  illumination,  the  system  becomes  noise  limited  rather  than 
transfer  limited.  The  relating  equations  in  terms  of  threshold 
contrast  requirements  have  been  developed  by  Hodara  ' 'L7^and  are 
based  on  the  premise  that  the  threshold  detector  contrast  is  given 
by, 

CD  = SNR/^-  (98) 

where  Cjj  = threshold  detector  contrast 

= total  number  of  photons  per  unit  area 
He  has  shown  that  equation  (98)  can  be  cast  into  terms  of  the 
detector  characteristics  as, 

SNR  • y - . 


(99) 


t 


L I 


where,  V = spatial  frequency  (cycles/mm) 

Q = quantum  efficiency  of  the  detector 

N = total  number  of  photons  /rnm^ 

2 

Nn  = noise  photons  /mm 
= transfer  function 

For  weak  illumination  and  low  resolution  'E'Cv)  =1  and  equation  (99) 
becomes , 

SNR*  V =-  Cp/  Q (100) 

* l +■ 

For  strong  illumination  and  high  resolution,  equation  (99)  becomes, 

r -7  (101) 

v =/  Q^Zco/snr]  fa>) 

or  transfer  limited.  For  each  detector  type,  specified  by  Q and  Nn, 

a plot  of  SNR«y/CD  versus  for  weak  illumination  determines 

the  detector  requirements.  For  the  strong  illumination  case,  a 

2 • ) 

plot  of  versus  N^_  (C^/SNR)  determines  the  detectors  "seeing" 

ability.  In  either  case,  the  dominance  of  either  N or  will 

n 

be  determined  by  detector  type  and  N^_.  To  simulate  the  different 
conditions,  it  is  only  necessary  to  monitor  in  the  image  and 
the  detector  seeing  ability  can  be  determined  from  equation  (99) 
with  input  parameters  of  SNR,  Cp,  Q and  N^.  It  is  proposed  to 
simulate  this  parameter  by  simply  measuring  the  photon  flux  in 
the  image  plane  and  relating  this  to  the  detector  characteristics 
through  equation  (99)  . 
e) Bioluminescence  Simulation: 

We  have  shown  in  section  IV-C, using  as  an  illustration  the  myc- 
tophid  genus  Diaphus,  that  the  spatial  arrangement  of  the  photophoros 
in  principle  might  be  used  for  identification  of  the  myctophid  species. 
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Due  to  the  expected  high  data  rate  necessary,  it  appears  that  this 
would  be  extremely  difficult.  However  in  order  to  experimentally 
verify  this,  it  is  proposed  to  simulate  the  biolumuscent  photophores 
as  follows. 

In  the  input  object  plane,  a mask  is  prepared  simulating  the 
photophoric  arrangement.  This  is  diffusely  illuminated  in  mono- 
chromatic light  of  controlled  intensity  (A~  480  nm)  and  passed 
through  the  simulator.  The  various  parameters  are  applied  and  the 
resultant  image  is  examined  either  visually  or  eventually  with  the 
pattern  recognition  system.  The  results  of  this  type  of  testing 
will  determine  whether  this  parameter  is  a viable  means  of  identi- 
f iction . 
fj_  Summary  : 

The  seawater  optical  simulator  to  produce  the  various  effects 
discussed  above  is  shown  in  figure  14.  The  input  object  to  be  used 
can  be  film  or  direct  projection  from  a specimen  of  lantern  fish. 

If  film  is  used  as  the  input,  35mm  transparencies  can  be  prepared 
from  photographs  taken  of  the  specimens  of  lantern  fish  found  for 
example  at  the  Smithsonian  Institute. 


3.  Optical  Pattern  Recognition: 

As  mentioned  above,  due  to  the  rapid  towing  rates  desired  for  the 
recognition  and  counting  system,  it  appeared  that  computer  sequential 
image  processing  is  not  adequate  and  a parallel  processing  system  is 
necessary. 

It  is  the  purpose  of  this  phase  of  the  work  to  examine  the  pract- 
icality of  using  Fourier  transform  principles  to  do  the  recognition 
and  counting  utilizing  a hybrid  optical/computer  system.  It  is  intended 
to  work  entirely  in  frequency  space  as  motion  of  the  object  does  not 
affect  the  transform.  The  transform  is  affected  by  orientation,  size 
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shape  and  number. 

The  principle  to  be  used  in  developing  a system  is  the  following. 

In  any  imaging  system,  (disregarding  the  degradation  due  to  the  optics 
for  the  moment)  using  incoherent  light,  the  object  spectrum  is  the 
autocorrelation  of  the  amplitude  transform,  i.e.. 


(Object) 

and, 

Q(cS)  = GCui  ®Cx*(co')  UOJ) 

Due  to  the  two  demensional  nature  of  the  object  spectrum,  any 
asymmetry  in  the  object  will  produce  an  asymmetrical  spectrum.  As 
the  object  rotates,  the  spectrum  also  rotates  (orientation  effect) . 

In  addition,  the  size  of  the  object  will  determine  the  magnitude 
of  the  high  frequency  components  while  the  shape  determines  the 
asymmetry  in  the  spectrum.  Also  if  two  similar  objects  are  in  the 
field  of  view  of  the  optical  system  in  the  same  orientation,  the 
resultant  spectrum  is  the  same  but  with  twice  the  intensity.  If  three, 
then  three  times  the  intensity  and  so  on. 

In  principle,  if  the  resultant  spectrum  can  be  harmonically  ana- 
lyzed radially,  the  average  size  and  shape  can  be  determined  and  from 
the  strength,  the  number  of  objects.  In  dealing  with  schools  of  lan- 
tern fish, (i.e.  numbering  in  the  thousands)  it  is  not  expected  to  be 
able  to  count  the  number  exactly  but  to  acheive  average  number,  aver- 
age size  etc.  as  the  fabrication  of  a system  to  count  individually 
would  be  an  enormous  task. 

In  an  incoherent  system,  it  is  not  possible  to  work  directly  in 
frequency  space  (i.e.  a physical  plane)  but  by  the  judicious  use  of 
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masks  and  lens  aberrations,  the  object  spectrum  can  be  analyzed  due 
to  the  relationship. 


I C to)  — Cto)  O Cfo)  (104) 

where  the  'Z~(co)  of  the  optical  system  can  be  varied  to  analyze  the 
O (CO ) . For  example,  if  two  slits  are  place  in  the  exit  pupil  of  the 
system,  the  (CO  ) consists  of  a d-c  term  plus  spectral  components 

at  LOq  = + . By  varying  the  distance  of  the  slits,  we  are  in 

effect  harmonically  analyzing  the  structure  of  the  object  intensity 
distribution.  An  annulus  in  the  exit  pupil  effectively  does  the  same 
thing  except  radially. 

It  will  be  the  purpose  of  this  part  of  the  work  to  develop  ways 

of : 

1)  radially  varying  the  2"  (CO) 

2)  asymmetrically  varying  the  2"  (CO) 

3)  determining  the  effects  on  the  object  spectrum 
In  order  to  keep  pace  with  the  rapidly  varying  object  distribution, 
the  variations  in  2" (CO)  must  be  made  rapidly-  possibly  mechanically 
or  even  electro-optically . 

To  expand  on  the  principle  to  be  used  in  optical  pattern  recog- 
nition and  counting,  we  utilize  the  geometry  depicted  in  figure  15. 
Here,  0(£)  represents  the  object  (objects)  intensity  distribution, 
P(4J)  represents  the  pupil  amplitude  distribution  at  the  exit  pupil 
of  the  optical  system  (expressed  as  frequency  units), and  I(x)  the 
image  plane  intensity  distribution  where  the  measurements  are  made. 
Depending  on  the  number  of  objects  in  the  field  of  view  at  a given 
time,  we  denote  the  0 ( £.  ) as. 
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0(e)=  + + . ••  (105) 

where  the  oi  ’ s reflect  the  maximum  radiance  from  the  oLjects  (i.e. 
product  of  illuminating  source  density  and  diffuse  reflectivity  of 
the  objects),  the  f's  represent  the  radiance  distribution  of  each 
object  and  the  b's  represent  the  location  of  each  object  referred 
to  the  center  of  the  optical  system.  Equation  (105) is  Fourier  trans- 
formed in  intensity  and  utilizing  the  linearity  and  shift  theorems, 
and  can  be  written  as, 

— ot,  0 1 0^)  ■+*  +*3$ 3 Me.  +•  > • (106) 

In  the  case  of  a school  of  fish  of  the  same  family  (i.e.  approx- 
imately the  same  size  with  equal  relectivities  and  oriented  in  the 
same  direction) , we  can  write. 


O6o)  = N Cl  +-  +e' 


i-wb.,  J 


(107) 


where  N = the  number  of  objects. 

If  the  distribution  of  the  fish  is  random  but  the  same  orientation, 
then  the  linear  phase  shift  terms  do  not  acquire  a finite  mean  value 
and  except  for  local  fluctuations  equation  ( 107 ) becomes , 


OCc o)  = N <*  I + residual] 


(108) 


From  equation  (83)  we  stated  that  the  incoherent  transfer  function 
of  the  optical  system  can  be  expressed  as, 

r*cco)  = Kco)  0 (109) 

where  P (co  ) is  the  pupil  function.  Combining  this  with  equation ( 108 ) , 
we  have  that. 
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1 (co)  = O^)  * ^ 

X(co)  - N o<  g Coj)  -~P6o)  ©~P*Oo) 


(110) 


Transforming  (110)  results  in. 


XCx)  = Nlo(  j-QO  oT>W>-P  6°) 


(in) 


where  P(cO)  is  the  transform  of  the  pupil  function.  Hence, 


XCx)  = lsl  01  § ce)  © | PCu>)V 


(112) 


Effectively,  equation  (112) indicates  that  the  resultant  image  distri- 
bution can  be  encoded  according  to  the  pupil  function  transform  P(co). 
As  the  form  of  P (to ) is  at  the  discretion  of  the  system  designer, 
it  can  be  seen  that  if  P(6t>)  is  a time  varying  function  properly 
chosen,  the  resultant  intensity  distribution  variation  can  be  used 
to  determine  N if  CX  and  f(£)  are  known  (i.e.  shape  size  and  reflect- 
ivity). In  addition,  due  to  the  asymmetry  of  the  nekton,  the  time 
variation  of  P(cO)  must  be  done  in  such  a way  that  the  asymmetry  can 
be  measured.  This  will  be  the  main  thrust  of  this  phase  of  the  work. 

As  an  example  of  how  P(cc))  affects  the  image  coding,  a simple  form 
for  P(fcO)  is  an  annulus  described  mathematically  as  a radial  delta 


function. 


~PG J)  - S (uj-co0') 


(113) 


where U)  is  the  location  of  the  annulus.  It  can  be  shown  that  the 

O 

Fourier-Bessel  transform  of  (113)  is, 


- CL) o To  C(aJ©x) 


(114) 
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Consequently, 


PCco)lZ  - tOoM  T0C0J0X) 


(115) 


Substituting  into  equation ( 112 ) we  have  that, 

I(x)  = M CX  60,^:  1 JoL^o  Cx-  Ojfd  £ 

Now,  if  the  entire  image  is  integrated  then, 

- N 0(00^ JJ^\ J-oL^oO-dUdedx 


(116) 


(117) 


N = 


JGO  dLx 


ex  /Y JttD I j;l^0u-e)]lJd£4x 

ENCODED  IMAGE 


(118) 


Since  oJ0 , o<  and  f ( €.  ) are  known,  measurement  of  the  total  integrated 
image  produced  by  the  restricted  pupil  function  is  directly  related 
to  number. 

It  is  to  be  noted  that  equation ( 118)  is  independent  of  the  fish 
motion  as  long  as  the  fish  are  in  the  field  of  view.  This  technique 
relaxes  immeasurably  the  previous  requirement  of  limiting  the  image 
analysis  to  1/10  of  a resolution  element.  Consequently,  instead  of 
requiring  50,000  frames/sec.,  we  require  that  the  harmonic  analysis 
be  made  during  the  transit  time  in  the  field  of  view.  For  example, 
at  a relative  speed  of  10  knots  (5  meters/sec.)  with  a minification 
ratio  of  100:1  and  an  image  format  of  5cm.x5cm.,  the  pupil  function 
is  to  varied  once  a second.  This  allows  the  use  of  mechanical  vari- 
ation instead  of  electro-optical  which  reflects  the  simplification 
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obtained  by  parallel  processing 


In  the  above  analysis,  it  was  assumed  that  the  school  of  fish  were 
oriented  in  the  same  way.  Under  real  conditions,  this  may  not  be  the 
case  and  only  the  average  size  and  number  will  be  obtained  depending 
on  the  weighting  factors  of  the  radiance  of  each  object.  Additionally, 
it  is  to  be  recognized  that  equation  (117)  admits  to  unique  solutions 
in  N and  f (£  ) when  is  varied  in  a prescribed  manner.  In  other 
words  for  a fixed  N and  o(  , only  one  combination  of  / (x)dx  with  o00 
is  consistent  with  a given  f ( £ ). 
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VI.  CONCLUSIONS  AND  RECOMMENDATIONS 


The  primary  motivation  for  this  study  was  the  recognized  need 
to  augment  existing  methods  for  sampling  mid-water  nekton.  Generally, 
the  need  for  a pattern  recognition  system  to  recognize  and  count 
has  become  apparent  during  the  course  of  this  study.  For  high  tow 
rates  of  the  veiwing  vehicle,  the  need  for  an  optical  pattern  rec- 
ognition technique  appears  to  be  necessary  as  a parallel  processing 
computer  recognition  system  cannot  handle  the  high  information  rates 
that  are  necessary  for  recognition. 

Specifically,  we  have  shown  in  the  first  phase  of  this  study  that: 

1)  a viewing  system  will  only  be  able  to  recognize  and  count  nekton 
of  grossly  different  morphology 

2)  the  myctophids  and  euphasiids  represent  the  lower  limit  of 
nekton  recognition  based  on  size  and  reflectivity 

3)  the  viewing  system  must  operate  at  relatively  close  range-- 
on  the  order  of  20  meters — in  order  to  recognize  the  variety 
of  nekton 

4)  in  order  to  achieve  the  largest  possible  sampling  volume,  the 
illuminating  beam  used  in  the  towed  fish  should  be  deployed 
in  some  circular  fashion 

5)  resolution  and  hence  recognition  is  detector  limited  and  not 
limited  by  the  sea-water  transfer  function 

6)  a viable  viewing  system  must  incorporate  a recognition  system 

to  be  able  to  count  in  real  time  the  expected  number  and  variety 
of  nekton 

In  the  second  phase  of  this  study,  we  have  shown  that: 

7)  geometric  pattern  recognition  does  appear  to  be  a sufficient 
discriminant  for  the  myctophid  family  of  nekton 
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8)  bioluxninescence  and  the  spatial  arrangement  of  the  photophores 
of  the  nekton  might  be  used  as  a recognition  parameter  if  a 
suitable  recording  scheme  can  be  developed 

9)  under  high  tow  rates,  computer  pattern  recognition  cannot  be 
used  and  an  optical  pattern  recognition  scheme  must  be  devel- 
oped 

10)  the  image  degradation  due  to  sea-water/detector  combination 
can  be  simulated  optically  in  the  laboratory  without  resort 
to  sea-trials  for  confirmation  of  the  pattern  recognition 
system 

It  is  recommended  that  the  next  phase  of  this  study  should  con- 
centrate on  developing  the  optical  pattern  recognition  techniques 
necessary  to  recognize  and  count  nekton  using  the  myctophid  family 
of  nekton  as  a model.  Specifically,  the  following  items  are  recom- 
mended for  study  in  future  work: 

1)  experimentally  simulate  the  key  sea-water  parameters  and  the 
detector  characteristics.  In  particular,  the  following  para- 
meters should  be  simulated: 

a)  uniform  motion  in  one  direction 

b)  sea  transfer  function  with  range 

c)  orientation  of  test  objects,  background  scattering  and 
sea-water  attenuation 

d)  detector  characteristics 

e)  bioluminesecence  and  spatial  arrangement  of  photophores  of 
myctophids 

2)  utilizing  the  specimen  collection  of  myctophids  at  the  Smith- 
sonian Institute,  prepare  suitable  photographic  transparencies 
as  input  objects  to  the  optical  simulator 

3)  design  of  the  optical  pattern  recognition  module  for  myctophids 


-68- 


with  emphasis  on  developing  methods  for  rapidly  modifying  the 
pupil  function  of  the  recognition  system  in  a prescribed  manner 
4)  incorporate  myctophid  characteristics  as  is  known  by  the  bio- 
logical community  to  augment  the  design  of  the  myctophid  recog- 
nition module 
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FIGURE  2.  Geometry  Used  To  Derive  The  Modulation  Transfer  Function  For  A Fan  Beam (See 


LIMITING  VALUE 


(CONTRAST) 


FIGURE  6.  SCATTERING-LAYER  ORGANISMS  include  crustaceans  and  fishes.  Among  them  are 
7 top  to  bottom)  a "euphausiid",  a sergestid  and  two  forms  of  myctophids  or  lantern 
fish.  The  animals  range  in  size  from  about  an  inch  for  the  euphausids  up  to  three 
inches  for  the  lantern  fish.  The  four  spots  on  the  euphausids  and  the  similar  spots 
on  the  myctophidc  are  photophores  or  light-producing  organs. 


I 

FIGURE  12.  Hie  Different  Spatial  Arrangement  Of  Photophores  In  A Closely 

Related  Group  Of  Lantern  Fish  of  the  Genus  DIAPHUS.  In  the  left 
row  from  top  to  bottom,  DIAPHUS  MACROPHUS,  DIAPHUS  LUCIDUS  and 
DIAPHUS  SPLEM)IDUS , Right  Row,  DIAPHUS  GARMANI  and  DIAPHUS  EFFULGENS. 
Each  species  has  developed  its  own  pattern,  different  from  all  the 
rest,  which  enables  a lantern  fish  to  identify  other  individuals  of 
its  own  species. 
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Note:  All  nekton  appear  to  have  positive  phototropism  except  the  Myctopidae. 
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PROFILE  OF  MESOPELAGIC  ORGANISMS  IN  N.E.  TROPICAL  PACIFIC  DETERMINED 
WITH  A TUCKER  O/C  TRAWL  AT  270-350  M.  (21,035  M3  FILTERED)* 


CRUISE: 

STATION: 

GEAR: 

HAUL : 

DURATION: 

SAMPLING: 

TIME: 

MAXIMUM: 

WIRE  OUT: 

SAMPLING: 

SPEED: 


MINOX  3 

8 - TRANSITION  FRONTAL 
TUCKER  O/C  TRAWL 

START  - 1509;  FINISH  - 1657;  TOTAL  - 108  MINUTES 

OPEN  - 1528;  CLOSE  - 1643;  TOTAL  - 75  MINUTES 

► 

M ; SAMPLING  INTERVAL:  270  - 350  M. 

2.25  KNOTS  (70.1  M/MIN) ; VOLUME  FILTERED:  21,035  M3 


DATE:  28  OCTOBER  1973 
HAUL:  36 


ORGANISMS 

FISHES: 

MYCTOPHIDS 

CYCLOTHONE 

VINCIGUERRIA 

FRAGMENTS 


TOTAL  COUNT 


29 

8 

247 

2 


OTHERS: 


COPEPODA  20,246 
AMPHIPODA  4 
PENAEIDA  37 
EUPHAUS IACEA  (ADULTS)  1,393 
OSTRACODA  1 
STOMATOPODA  3 
CEPHALOPODA  1 


*VENT,  R.J.  and  G.V.  Pickwell,  Acoustic  Volume  Scattering  Measurements 
With  Related  Biological  and  Chemical  Observations  in  the  Northeastern 
Tropical  Pacific  (U)  NUC  TP  525,  Naval  Under  Sea  Center,  San  Diego, 
California  92132  (1976) . 


COLORATION  OF  MESOPELAGIC  NEKTON  AND  RELATED  ORGANISMS 


PLANKTON 


COPEPODS 

TRANSLUCENT/ 

ARROW  WORMS 
SIPHONOPHORES 

TRANSPARENT 

MEDUSAE 

AGLISCRA  IGNEA 

FLAMING  RED 

NEMERTEAN  WORMS 

REDDISH 

ARROW  WORMS 

SAGITTA  MACROCEPHALA 

SPECKLED  OR  SUFFUSED 

EUKROHINA  FOWLERI 

WITH  RED  PIGMENTS 

COPEPODS 

GAETANUS 

RED 

OSTRACODS 

GIGANTOCYPRIS 

RED  & ORANGE 

PRAWNS 

ACANTHEPHYRA 

SYSTELLASPIS 

SCARLET 

CEPHALOPODS 

MASTIGOTEUTHIS 

HISTIOTEUTHIS 

RED 

WHALE-FISHES 

RED  OR  PLUM 

CYCLOTHONE 

C.  SIGNATA 

C.  BRAVERI 

PALE  OR  TRANSLUCENT 

GONOSTOMIDAE 

VINCIGUERRIA 

SILVER  SIDED  FISH 

STERNOPTYCHIDAE 

HATCHET  FISH 

SILVER  SIDED  FISH 

MYCTOPHIDAE 

LANTERN  FISH 

SILVER  SIDED  FISH 

ASTRONESTHIDAE 

STAR  EATERS 

DARK  COLORED  FISH  ARMED 
WITH  LONG,  SHARP  TEETH 

MELANOSTOMIATIDAE 

DRAGON  FISHES 

DARK  COLORED  FISH  ARMED 
WITH  LONG,  SHARP  TEETH 

MALACOSTEIDAE 

RAT  TRAP  FISHES 

DARK  COLORED  FISH  ARMED 
WITH  LONG,  SHARP  TEETH 

CHIASMODONTIDAE 

GIANT  SWALLOWERS 

DARK  COLORED  FISH  ARMED 
WITH  LONG,  SHARP  TEETH 
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CHARACTERISTICS  OF  MYCTOPHID  FISH  (Ceratoscopelus  Maderensis) 
DETERMINED  IN  SLOPE  WATER  BY  THE  DEEP  SUBMERGENCE  VEHICLE 
ALVIN'S  ECHO-RANGING  SONAR* 


• 

LOCATION  OF  STUDY 

South  of  Woodshole,  MA 

30°  48'N,  70°  33 'W 

DEPTH 

To  1800  m. 

1 

ECHO  SOUNDER  CHARACTERISTICS 

Discrete  hyperbolic  echo- 
sequences  at  12  KHz  (Midday 
Depth) ; 3 KHz  at  30  m. 

TARGET  IDENTIFICATION 

Captured  by  driving  Alvin 
through  school. 

1 

FISH  SIZE 

X = 62.4  iran 

SD  = 2.9  iran 

RANGE  = 52  -73  mm 

COMPUTATION  OF  NO.  TARGETS 

I 

VOLUME  SEA  WATER 

23.76  X 105  m3 

FISH  DENSITY 

10-15/  m3  water 

FISH  SCHOOL  DIMENSIONS 

» 

THICKNESS 

DIAMETERS 

DISTANCE  APART 

5 - 10  m 

10  - 100  m 

100  - 200  m 

I 

ATTITUDE  IN  WATER 

Fish  at  rest,  motionless, 
horizontal  or  slightly  oblique, 
random  orientation. 

» 

RESPONSE  OF  FISH  TO  APPROACHING 
ALVIN 

Moved  down  and  away;  fish  moved 
more  rapidly  in  shallow  water 
than  deep  water. 

RESPONSE  TO  LIGHT  (TUNGSTEN) 

Rapidly  swam  away  (negative 
phototropic  response) . 

1 

*Af ter  Science,  160,  991-993  (1968). 

» 

Ji 


i 
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DATA  TRANSMISSION  ANALYSIS 


This  analysis  is  for  the  case  of  a fan  beam  scanned  back  and  forth 
producing  a pyramid  shaped  volume  as  shown  in  figure  B-l.  The  volume 
of  the  pyramid  is  1/3  S^R  consisting  of  frames  of  Ne  sides  where  N is 
the  number  of  photodiodes  in  a linear  array  and  e the  resolution  length. 
It  is  assumed  that  the  depth  separation  between  frames  is  lOe.  In 
addition,  there  are  elements/frame  and  there  are  lOeR  frames  per 
pyramid  volume,  if  we  assume  an  e = .1  meters  at  100  meters  and  an 
N = 50,  then  the  volume  of  the  pyramid  is  about  8 33  meters-^,  there 
are  2500  elements  per  frame  and  there  are  100  frames  per  volume. 

For  the  purposes  of  this  analysis,  we  will  assume  that  a Reticon 
50x50  photodiode  array  is  used  for  recording  which  has  a worst  case 
scan  rate  of  5x10^  elements/sec.  or  20x10  ^ sec. /elements.  The 
electronics  are  considered  at  this  rate.  Selected  arrays  may  be  faster 
and  optical  candidates  may  be  lower.  Either  direct  video  (analogue)  or 
digital  cable  transmission  is  possible. 

1.  Analogue  Transmission 

The  block  diagram  of  the  system  with  analogue  data  transmission  is 
shown  in  figure  B-2.  The  basic  element  clock  is  enabled  by  the 
synchronous  signal  from  the  fan  beam.  The  x and  y registers  are 
internal  to  the  array.  A composite  video  is  created  as  a result. 

Using  the  above  limitations  on  speed,  the  following  characteristics 
are  arrived  at: 


Levels  of  grey 
Elements/Volume 
Element  speed 
Transmission  Efficiency 
Allowable  cable  atten. 
Frame  speed 


16  5 

2.5x10 

5xl0^/sec. 

92% 

5.75  db  @ 100  KHz 
18. 5/sec. 


Since  a typical  cable  length  might  be  10,000  ft.,  this  means  an 
attenuation  of  .57  db/Kft.  @ 100  KHz.  This  would  appear  to  require 
a steel  jacketed,  coaxial  cable.  An  example  is  US  Steel's  2569RC 
with  an  attenuation  of  .55  db/Dft.  @ 100  KHz.  A shorter  cable  would 
allow  relaxation  on  the  characteristics.  Note  that  element  speed 
cannot  be  increased  and  the  cable  is  limiting.  The  transmission 
efficiency  above  is  due  to  the  short  time  for  the  end  of  line  and  end 
of  frame  pulses.  It  is  possible  that  additional  time  will  be  needed 
for  the  fan  beam  to  start  and  stop. 

The  above  cable  is  0.7"  in  diameter  and  weighs  700  lb./Kft.  It 
would  be  a major  cost  factor.  If  a less  costly  cable  were  desired,  a 
2J42RC  might  be  selected.  This  would  give  a 1.1  db/Kft.  @ 100  KHz 
and  would  require  a reduction  in  element  speed. 

2.  Digital  Transmission 

The  electronics  are  somewhat  different  from  the  analogue  case.  A 
block  diagram  of  a suggested  arrangement  for  digital  transmission  is 
shown  in  figure  B-3.  A bit  rate  clock  operates  at  5x  the  element  speed. 
A 4 bit  data  rate  (16  levels  of  grey)  are  used  and  formulated  as 
follows: 

start  bit  (1) 

word  1 4 bits 

word  2 4 bits 

stop  bit  (0) 

This  would  be  a total  of  10  bits  with  8 bits  of  data  and  2 words.  The 

total  transmission  efficiency  is  2499x4  bits  in  2500x5  bits  or  79.96%. 

The  system  chare. jceristics  are: 

Levels  of  grey  16  (4  bit) 

Elements/volume  2500 

Element  speed  5xl04 

Transmission  Eff.  80% 

Allowable  Cable  Atten.  3 db 

Frame  speed  16/sec. 


3.  Cables 


Cables  for  structural  and  data  transmission  are  manufactured  by  US 
Steel,  Rochester  Cable,  Victor  Cable  Co.,  etc.  Examples  for  US  Steel  are 


Manufacturer  # Dia.  (in.) 


Break  Pt. 
lbs. 


Wt.  (Ibs./Kft. ) Attn. 


US  STEEL 

2J69RC 

.686 

34,0 

II 

2H52RC 

.528 

20,0 

II 

2J42RC 

.420 

13,3 

II 

2H38RC 

.381 

12,6 

II 

2H30SC 

.298 

6,7 

Element 
Speed  Speed 
) (Sec"1) 


For  digital  transmission,  the  element  speed  will  be  0.45  of  the  above 
and  the  frame  speed  even  lower. 

4 .  Conclusions 

For  the  pyramid  scan,  the  cable  would  appear  to  be  the  important 
limitation  for  a maximum  data  rate.  Analogue  data  transmission  gives 
approximately  twice  the  frame  speed  of  the  digital  transmission.  Using 
the  cable  examples  shown  above,  we  have  that, 


Attenuation 


No.  (db/Kft.  @ 100KHZ) 


Transmission 


Digital  Transmission 


.55 

51.5 

19.0 

5.3 

23.' 

L.l 

31.0 

11.4 

8.8 

14. ( 

L.3 

26.6 

9.8 

10.2 

12.] 

L.9 

17.7 

6.5 

15.4 

8.( 

1 7.5 

13.3 

1 4.5 

22.2 

3.9 

25.6 

1 2.6 

38.4 

Hence  the  worst  case  of  5xl04  for  the  element  scan  would  appear  to  be 
consistent.  The  sample  rate  above  is  also  the  A/D  converter  rate.  High 
speed  8 bit  A/D  converters  are  capable  of  conversions  at  1 MHz  and 
therefore  are  by  no  means  limiting. 

5.  Additional  Comments  For  The  Pyramid  Shape  Scan 

For  the  examples  shown,  the  time/volume  varies  from  5.3  sec.  to  38.0 
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sec.  At  a tow  speed  of  1 knot  (%  meter/sec.),  the  separation  of  source 
and  viewing  system,  1^,  varies  from  2.6  meters  to  19.2  meters.  In  the 
first  case,  overlapping  occurs  and  in  the  second  a gap  exists.  It  would 
appear  that  some  consideration  should  be  given  to  circular  scanning  for 
more  optimum  coverage.  As  shown  in  the  previous  sections,  circular  scan- 
ning also  is  required  to  meet  some  of  the  resolution  and  sampling  area 
criteria. 

If  we  define  the  efficiency  of  coverage  as  proportional  to  the  volume 
seen  unduplicated  to  what  could  be  seen,  then  we  have  that. 


(Efficiency) 


1/3  RS2 

ELjS 

1/3  RS2 


for  L greater  than  S 
I 


- !j(S-L  )*R 


RLjS 


for  L, 


less  than  S 


Additionally,  if  T is  the  time/volume  and  u is  the  tow  speed,  then 

v 

L is  T xu.  If  we  assume  a tow  speed  of  u = 1 knot,  then  we  have  that, 
I v 


Time/Volume 
(sec. ) 


Coverage  Efficiency 
(%) 


4 

6 

8 

10 

20 

40 


38.3 

42.2 
39.1 

33.3 
16.6 

8.3 


fr  Figure  B-3.Exanple  Of  Block  Diagram  Of  A System  With  Digital  Transmission 
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